-- Logs begin at Mon 2022-07-25 08:02:04 UTC, end at Mon 2022-07-25 09:11:30 UTC. -- Jul 25 08:36:43.717806 dv-cinder-850840-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 08:36:43.729533 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 08:36:43.731028 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 08:36:43 2022] *** Jul 25 08:36:43.731028 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 08:36:43.731028 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 08:36:43.731028 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: nodename: dv-cinder-850840-1-iscsi Jul 25 08:36:43.731028 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: machine: x86_64 Jul 25 08:36:43.731028 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: clock source: unix Jul 25 08:36:43.731028 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: pcre jit disabled Jul 25 08:36:43.731028 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: detected number of CPU cores: 4 Jul 25 08:36:43.731028 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: current working directory: / Jul 25 08:36:43.731028 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: detected binary path: /usr/bin/uwsgi-core Jul 25 08:36:43.731719 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: your processes number limit is 47680 Jul 25 08:36:43.731719 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: your memory page size is 4096 bytes Jul 25 08:36:43.731719 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: detected max file descriptor number: 2048 Jul 25 08:36:43.731719 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: lock engine: pthread robust mutexes Jul 25 08:36:43.731719 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: thunder lock: enabled Jul 25 08:36:43.731719 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 08:36:43.731719 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 08:36:43.770669 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: Python main interpreter initialized at 0x5602fc9199c0 Jul 25 08:36:43.770669 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: python threads support enabled Jul 25 08:36:43.770669 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: your server socket listen backlog is limited to 100 connections Jul 25 08:36:43.770669 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: your mercy for graceful operations on workers is 90 seconds Jul 25 08:36:43.770982 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 08:36:43.771056 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: *** Operational MODE: preforking *** Jul 25 08:36:43.771323 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: *** uWSGI is running in multiple interpreter mode *** Jul 25 08:36:43.771323 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: spawned uWSGI master process (pid: 109713) Jul 25 08:36:43.771517 dv-cinder-850840-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 08:36:43.772061 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: spawned uWSGI worker 1 (pid: 109714, cores: 1) Jul 25 08:36:43.772605 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: spawned uWSGI worker 2 (pid: 109715, cores: 1) Jul 25 08:36:43.772605 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 08:36:44.425985 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 08:36:44.428331 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 08:36:45.494582 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:36:45.494582 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: from cryptography.utils import int_from_bytes Jul 25 08:36:45.495152 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:36:45.495152 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: from cryptography.utils import int_from_bytes Jul 25 08:36:45.496489 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:36:45.496489 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: from cryptography.utils import int_from_bytes Jul 25 08:36:45.496941 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:36:45.496941 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: from cryptography.utils import int_from_bytes Jul 25 08:36:47.975636 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 08:36:47.976224 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 08:36:47.976390 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 08:36:47.976783 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 08:36:47.977040 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 08:36:47.977423 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.977744 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.977870 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 08:36:47.978227 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.978311 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 08:36:47.978403 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.978647 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 08:36:47.978756 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.978983 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.979089 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 08:36:47.979275 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 08:36:47.979373 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.979598 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.979689 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.979922 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.980064 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.980162 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.980290 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.980479 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.980633 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.980823 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850840-1-iscsi {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.980971 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.981142 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.981288 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.981451 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.981611 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.981753 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.981934 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.982066 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.982263 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.982355 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.982528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.982670 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.982848 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.982971 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.983176 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850840-1-iscsi {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.983464 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.983569 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.983800 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.983926 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.984114 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.984228 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.984435 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.984555 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.984770 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.984885 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.985096 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.985204 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.985408 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.985506 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.985724 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.985918 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.986015 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.986232 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.986321 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.986540 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.986626 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.986854 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.987004 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850840-1-iscsi {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.987195 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.987319 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.987510 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.987629 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.987822 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.988010 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.988140 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.988332 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.988451 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.988668 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.988806 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.988992 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.989132 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.989292 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.989507 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850840-1-iscsi {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.989686 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.989827 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.990433 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.990660 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.990756 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.990979 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.991069 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.991364 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.991496 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.991674 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.991771 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.991971 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.992071 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.992276 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.992361 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.992590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.992697 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.992917 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.993013 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.993218 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.993312 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.993520 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.993615 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.993768 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.993855 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.994072 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.994179 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.994389 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.994482 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.994706 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.994792 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.995023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.995149 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.995275 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.995402 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.995537 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.995695 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.995808 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.996005 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.996123 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.996258 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.996427 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.996585 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.996766 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.996914 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.997069 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.997238 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.997370 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.997561 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.997659 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.997815 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.997960 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.998056 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.998261 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.998377 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.998568 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.998702 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.998878 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.999315 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.999489 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.999627 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.999808 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:47.999935 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.000113 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.000243 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.000428 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.000553 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.000842 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.000929 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.001098 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.001187 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.001394 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.001490 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.001729 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.001819 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.002043 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.002138 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.002349 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.002448 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.002663 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.002752 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.002980 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.003073 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.003284 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.003382 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.003587 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.003675 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.003888 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.003974 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.004203 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.004290 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.004532 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.004649 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.004857 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.004955 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.005106 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.005193 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.005404 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.005500 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.006268 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.006369 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.006585 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.006673 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.006888 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.006974 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.007192 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.007278 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.007495 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.007582 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.007790 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.007883 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.008091 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.008185 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.008395 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.008490 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.008720 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.008809 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.009026 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.009125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.009330 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.009413 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.009630 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.009720 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.009933 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.010033 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.010234 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.010319 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.010532 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.010617 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.010840 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.010933 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.011152 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.011239 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.011452 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.011539 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.011755 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.011848 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.012057 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.012145 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.012361 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.012448 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.012692 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.012795 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.012995 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.013091 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.013299 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.013386 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.013616 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.013715 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.013918 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.014005 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.014218 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.014310 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.014524 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.014611 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.014823 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.014909 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.015125 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.015211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.015433 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.015593 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.015729 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.015814 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.016031 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.016116 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.016342 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.016429 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.016671 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.016770 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.016973 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.017059 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.017271 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.017359 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.017571 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.017657 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.017869 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.017955 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.018452 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.018545 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.018752 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.018839 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.019052 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.019138 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.019346 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.019443 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.019659 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.019753 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.019963 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.020057 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.020267 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.020359 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.020618 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.020718 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.020895 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.020990 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.021225 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.021316 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.021533 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.021621 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.021837 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.021933 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.022157 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.022244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.022482 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.022568 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.022793 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.022891 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.023103 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.023197 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.023412 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.023506 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.023724 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.023820 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:36:48.024039 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.024138 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.024360 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.024446 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.024695 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.024792 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.025002 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.025088 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.025311 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.025396 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.025624 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.025711 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.025936 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.026023 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.026261 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.026355 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.026575 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.026669 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.026889 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.026975 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.027202 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.027315 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.027509 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.027605 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.027821 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.027906 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.028142 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.028238 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.028460 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.028550 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.028792 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.028893 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.029129 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.029224 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.029450 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.029536 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.029760 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.029853 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.030070 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.030168 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.030385 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.030470 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.030693 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.030778 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.031000 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.031098 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.031306 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.031393 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.031624 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.031709 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.031948 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.032047 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.032255 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.032350 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.032585 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.032675 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.032918 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.033075 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.033204 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.033293 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.033511 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.033606 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.033818 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.033906 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.034124 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.034210 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.034453 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.034548 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.034765 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.034851 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.035074 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.035159 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.035383 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.035468 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.035693 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.035779 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.035998 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.036082 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.036305 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.036402 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.036631 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.036721 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.036964 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.037061 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.037295 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.037397 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.037610 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.037705 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.037918 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.038012 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.038221 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.038389 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.038542 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.038630 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.038855 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.038948 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.039156 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.039250 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.039466 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.039560 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.039776 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.039861 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.040083 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.040169 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.040387 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.040472 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.040716 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.040807 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.041020 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.041109 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.041327 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.041425 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.041636 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.041723 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.041937 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.042078 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.042254 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.042340 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.042561 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.042654 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.042864 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.042952 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.043176 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.043261 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.043475 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.043569 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.043776 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.043868 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.044085 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.044171 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.044398 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.044502 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.044717 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.044805 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.045026 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.045113 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.045336 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.045469 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.045657 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.045758 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.045963 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.046073 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.046270 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.046381 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.046583 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.046670 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.046899 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.046986 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.047199 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.047292 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.047517 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.047603 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.047831 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.047919 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.048144 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.048238 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.048450 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.048539 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.048784 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.048924 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.049088 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.049177 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.049389 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.049475 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.049691 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.049777 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.049997 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.050084 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.050297 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.050385 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.050598 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.050693 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.050899 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.050997 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.051200 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.051294 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.051500 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.051596 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.051817 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.051903 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.052124 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.052210 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.052965 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.053074 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.053271 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.053358 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.053573 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.053667 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.053880 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.053977 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.054192 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.054278 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.054501 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.054594 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.054824 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.054923 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.055137 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.055224 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.055447 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.055540 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.055755 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.055849 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.056061 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.056168 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.056369 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.056466 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.056701 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.056792 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.057014 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.057100 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.057323 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.057409 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.057642 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.057739 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.057951 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.058038 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.058265 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.058363 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.058574 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.058661 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.058897 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.058983 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.059207 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.059335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.059523 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.059826 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.059911 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.060139 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.060474 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.060597 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.060827 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.060916 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.061142 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.061228 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.061461 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.061561 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.061769 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.061855 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.062081 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.062175 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.062388 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.062485 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.062695 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.062788 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.063003 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.063097 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.063311 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.063398 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.063626 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.063711 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.063932 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.064052 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.064247 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.064377 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.064553 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.064733 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.064895 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.065071 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.065204 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.065518 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.065660 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.065825 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.066044 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.066200 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.066369 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.066519 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.066677 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.066765 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.066997 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.067099 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.067325 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.067411 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.067644 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.067739 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.067949 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.068710 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.068801 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.068892 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.069123 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.069218 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.069427 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.069521 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.069731 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.069825 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.070039 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.070167 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.070351 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.070451 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.070660 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.070746 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.070969 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.071054 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.071270 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.071369 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.071581 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.071669 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.071887 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.071974 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.072188 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.072276 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.072490 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.072597 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.072824 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.072922 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.073145 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.073233 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.073451 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.073537 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.073762 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.073847 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.074080 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.074174 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.074383 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.074477 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.074686 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.074780 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.074990 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.075077 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.075297 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.075382 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.075598 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.075693 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.075900 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.076033 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.076201 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.076287 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.076514 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.076664 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.076860 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.076946 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.077162 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.077292 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.077476 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.077572 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.077793 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.077878 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.078102 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.078188 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.078411 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.078504 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.078719 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.078814 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.079030 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.079154 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.079338 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.079433 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.079645 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.079731 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.079951 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.080046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.080258 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.080388 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.080565 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.080671 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.080892 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.080978 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.081198 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.081285 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.081515 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.081601 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.081822 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.081908 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.082129 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.082250 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.082434 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.082521 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.082737 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.082838 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.083044 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.083131 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.083356 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.083443 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.083692 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.083949 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.084037 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.084276 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.084363 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.084613 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.084707 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.084925 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.085014 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.085240 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.085327 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.085563 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.085658 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.085867 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.085956 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.086183 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.086280 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.086495 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.086590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.086807 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.086905 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.087116 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.087203 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.087419 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.087679 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.087773 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.088014 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.088100 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.088312 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.088397 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.088636 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.088742 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.088943 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.089031 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.089250 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.089336 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.089549 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.089648 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.089848 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.089936 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.090149 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.090242 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.090450 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.090547 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.090759 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.090855 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.091058 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.091151 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.091364 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.091450 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.091662 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.091750 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.091978 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.092064 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.092282 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.092368 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.092618 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.092722 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.092900 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.092988 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.093202 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.093312 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.093535 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.093621 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.093836 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.093923 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.094139 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.094233 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.094454 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.094541 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.094764 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.094850 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.095080 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.095175 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.095378 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.095464 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.095698 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.095793 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.096000 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.096096 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.096300 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.096387 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.096624 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.096715 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.096934 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.097023 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.097238 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.097333 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.097536 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.097622 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.097843 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.097931 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.098146 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.098232 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.098453 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.098539 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.098757 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.098845 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.099061 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.099150 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.099390 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.099479 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.099692 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.099780 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.100002 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.100089 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.100307 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.100402 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.100631 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.100721 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.100936 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.101039 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.101242 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.101338 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.101546 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.101634 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.101844 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.101931 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.102151 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.102251 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.102451 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.102546 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.102755 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.102841 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.103054 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.103154 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.103354 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.103442 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.103653 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.103744 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.103960 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.104048 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.104262 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.104347 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.104561 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.104661 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.104896 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.105002 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.105202 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.105288 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.105504 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.105603 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.105805 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.105894 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.106107 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.106205 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.106405 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.106490 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.106706 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.106793 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.107011 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.107106 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.107318 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.107413 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.107627 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.107719 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.107927 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.108022 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.108231 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.108331 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.108529 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.108671 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.108852 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.108950 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.109157 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.109253 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.109461 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.109563 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.109761 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.109855 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.110057 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.110154 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.110355 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.110455 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.110655 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.110742 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.110954 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.111043 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.111270 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.111358 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.111573 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.111657 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.111870 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.111957 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.112169 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.112263 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.112466 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.112552 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.112797 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.112894 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.113109 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.113203 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.113415 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.113511 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.113720 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.113809 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.114027 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.114113 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.114335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.114430 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.114640 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.114725 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.115478 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.115598 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.115787 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.115925 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.116087 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.116374 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.116467 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.116716 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.116807 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.117028 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.117128 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.117329 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.117419 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.117629 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.117725 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.117945 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.118034 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.118253 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.118341 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.118560 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.118657 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.118877 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.118965 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.119194 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.119281 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.119518 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.119614 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.119818 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.119904 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.120124 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.120213 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.120431 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.120531 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.120761 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.120864 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.121067 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.121168 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.121373 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.121534 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.121678 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.121765 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.121985 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.122073 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.122293 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.122390 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.122600 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.122696 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.122907 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.123012 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.123209 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.123298 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.123513 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.123601 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.123818 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.123914 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.124119 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.124208 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.124429 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.124515 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.124758 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.124847 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.125061 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.125151 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.125367 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.125454 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.125666 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.125755 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.125973 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.126062 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.126273 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.126367 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.126584 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.126679 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.126898 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.126997 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.127206 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.127302 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.127506 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.127604 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.127821 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.127909 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.128131 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.128220 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.128459 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.128554 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.128793 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.128884 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.129095 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.129182 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.129444 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.129544 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.129754 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.129852 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.130071 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.130165 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.130380 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.130495 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.131266 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.131355 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.131570 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.131657 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.131879 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.131971 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.132199 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.132287 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.132499 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.132641 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.132828 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.132925 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.133130 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.133228 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.133445 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.133533 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.133747 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.133835 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.134066 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.134208 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.134477 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.134573 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.134786 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.134874 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.135089 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.135176 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.135422 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.135516 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.135732 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.135819 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.136046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.136132 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.136370 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.136466 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.136712 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.136815 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.137022 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.137110 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.137324 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.137421 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.137621 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.137708 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.137926 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.138021 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.138247 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.138344 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.138568 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.138655 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.138875 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.138969 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.139187 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.139277 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.139493 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.139665 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.139801 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.139987 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.140117 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.140301 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.140427 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.140648 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.140750 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.140976 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.141163 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.141290 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.141485 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.141597 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.141794 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.141913 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.142111 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.142227 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.142432 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.142553 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.142733 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.142880 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.143033 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.143456 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.143606 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.143775 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.143909 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.144083 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.144212 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.144407 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.144533 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.144758 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.144858 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.145075 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.145171 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.145403 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.145513 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.145739 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.145846 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.146039 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.146173 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.146363 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.146493 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.146682 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.146822 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.146983 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.147150 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.147369 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.147477 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.147608 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.147755 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.147924 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.148069 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.148241 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.148377 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.148543 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.148710 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.148881 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.149040 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.149186 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.149347 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.149491 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.149660 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.149791 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.149978 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.150090 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.150289 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.150428 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.150599 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.150729 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.150906 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.151044 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.151231 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.151370 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.151539 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.151694 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.151865 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.152000 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.152182 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.152334 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.152516 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.152680 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.152881 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.152996 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.153192 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.153311 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.153519 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.153621 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.153832 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.153919 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.154142 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.154237 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.154450 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.154545 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.154760 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.154854 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.155075 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.155162 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.155377 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.155465 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.155681 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.155769 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.155980 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.156067 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.156278 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.156368 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.156617 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.156751 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.156916 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.157045 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.157219 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.157335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.158475 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.158581 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.158663 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.158663 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.158663 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.158884 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.158969 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.159049 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.159128 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.159323 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.159420 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.159656 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.159751 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.159972 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.160059 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.160292 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.160379 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.160633 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.160723 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.160946 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.161046 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.161262 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.161349 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.161572 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.161659 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.162413 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.162578 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.162725 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.162816 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.163036 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.163122 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.163349 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.163444 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.163661 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.163754 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.163973 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.164066 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.164280 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.164375 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.164607 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.164716 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.164921 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.165015 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.165230 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.165336 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.165564 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.165747 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.165900 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.166074 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.166224 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.166390 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.166553 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.166703 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.166885 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.167014 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.167201 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.167326 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.167530 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.167680 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.167852 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.167947 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.168172 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.168260 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.168492 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.168606 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.168847 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.168947 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.169169 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.169256 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.169490 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.169584 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.169810 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.169907 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.170126 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.170213 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.170440 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.170527 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.170752 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.170853 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.171065 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.171161 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.171375 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.171587 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.171725 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.171923 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.172038 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.172243 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.172337 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.172563 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.172688 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.172908 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.172996 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.173228 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.173315 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.173545 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.173641 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.173850 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.173939 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.174161 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.174247 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.174470 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.174560 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.174778 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.174865 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.175085 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.175181 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.175393 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.175482 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.175702 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.175789 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.176021 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.176109 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.176351 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.176439 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.176690 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.176783 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.177002 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.177104 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.177312 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.177446 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.178214 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.178315 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.178533 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.178730 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.178826 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.179048 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.179135 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.179383 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.179479 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.179716 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.179810 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.180041 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.180173 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.180358 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.180455 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.180695 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.180785 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.181013 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.181099 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.181317 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.181415 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.181622 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.181756 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.181933 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.182021 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.182244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.182345 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.182548 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.182638 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.182868 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.182955 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.183178 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.183267 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.183480 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.183575 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.183796 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.183884 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.184102 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.184190 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.184642 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.184763 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.184966 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.185069 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.185288 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.185379 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.185612 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.185704 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.185935 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.186036 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.186250 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.186342 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.186555 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.186647 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.186875 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.186980 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.187179 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.187271 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.187484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.187575 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.187796 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.187895 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.188101 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.188216 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.188406 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.188504 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.188731 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.188858 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.189041 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.189131 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.189347 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.189448 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.189655 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.189752 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.189961 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.190049 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.190262 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.190500 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.190596 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.190878 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.190982 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.191160 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.191254 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.191461 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.191557 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.191770 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.191858 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.192071 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.192158 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.192370 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.192536 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.192695 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.192796 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.193017 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.193108 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.193326 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.193415 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.193626 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.193713 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.193932 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.194019 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.194234 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.194322 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.194539 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.194626 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.194838 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.194934 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.195144 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.195240 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.195489 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.195583 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.195801 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.195887 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.196105 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.196199 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.196407 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.196496 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.196742 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.196848 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.197054 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.197142 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.197363 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.197448 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.197669 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.197765 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.197975 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.198062 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.198329 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.198428 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.198587 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.198684 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.198895 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.199136 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.199231 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.199469 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.199566 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.199791 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.199887 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.200098 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.200184 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.200417 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.200512 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.200750 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.200840 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.201052 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.201139 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.201355 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.201456 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.201678 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.201766 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.201986 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.202073 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.202294 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.202391 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.202603 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.202692 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.202913 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.203002 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.203219 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.203319 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.203526 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.203652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.203832 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.203927 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.204136 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.204226 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.204440 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.204534 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.204771 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.205030 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.205125 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.205369 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.205457 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.205674 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.205767 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.205984 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.206079 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.206320 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.206406 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.206633 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.206718 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.206944 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.207032 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.207254 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.207340 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.207563 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.207649 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.207870 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.207959 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.208176 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.208270 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.208482 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.208621 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.208831 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.208920 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.209144 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.209231 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.209457 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.209542 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.209771 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.209867 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.210072 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.210159 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.210387 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.210529 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.210705 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.210792 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.211017 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.211111 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.211329 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.211429 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.211641 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.211729 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.211958 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.212044 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.212289 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.212384 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.212619 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.212711 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.212939 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.213027 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.213249 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.213339 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.213567 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.213654 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.213883 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.213970 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.214196 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.214285 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.214509 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.214596 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.214810 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.214896 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.215112 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.215201 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.215413 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.215508 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.215719 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.215820 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.216033 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.216128 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.216336 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.216451 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.216657 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.216806 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.216957 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.217132 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.217262 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.217457 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.217552 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.217773 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.217861 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.218097 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.218183 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.218421 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.218528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.218727 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.218827 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.219023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.219112 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.219323 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.219424 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.219628 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.219715 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.219925 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.220012 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.220222 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.220319 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.220521 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.220654 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.220848 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.220935 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.221146 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.221310 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.221445 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.221533 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.221743 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.221831 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.222042 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.222136 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.222339 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.222433 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.222663 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.222750 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.222990 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.223078 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.223300 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.223387 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.223616 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.223703 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.223918 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.224005 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.224742 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.224839 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.225063 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.225158 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.225374 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.225461 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.225726 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.225826 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.225987 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.226086 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.226292 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.226378 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.226597 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.226692 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.226901 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.226998 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.227205 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.227292 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.227510 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.227604 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.227813 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.227907 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.228114 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.228201 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.228416 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.228503 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.228766 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.228892 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.229071 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.229170 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.229379 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.229467 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.229701 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.229797 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.230018 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.230113 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.230332 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.230421 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.230643 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.230731 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.230948 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.231034 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.231271 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.231358 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.231577 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.231665 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.231883 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.231971 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.232188 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.232284 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.232493 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.232632 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.232825 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.232914 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.233197 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.233308 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.233441 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.233535 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.233747 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.233842 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.234056 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.234152 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.234363 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.234449 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.234673 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.234759 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.234990 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.235077 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.235294 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.235381 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.235613 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.235700 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.235932 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.236026 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.236247 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.236333 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.236586 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.236719 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.236915 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.237005 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.237228 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.237322 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.237537 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.237623 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.237846 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.237935 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.238147 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.238241 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.238386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 08:36:48.238487 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.238756 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.239072 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.239387 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.239698 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.240560 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.240903 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.241223 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.241551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.241879 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.242192 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.242517 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.242843 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.243195 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.243513 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.243856 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.244187 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.244507 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.244849 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.245157 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:36:48.245403 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 08:36:48.393038 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO dbcounter [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Registered counter for database nova_api Jul 25 08:36:48.399257 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO dbcounter [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Registered counter for database nova_api Jul 25 08:36:48.413387 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_db.sqlalchemy.engines [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:36:48.419158 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG oslo_db.sqlalchemy.engines [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:36:48.419909 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writer thread running {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:36:48.425547 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writer thread running {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:36:48.474041 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.context [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7421014a-aeb3-45a4-96f3-f2b361a942ff(cell1) {{(pid=109714) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 08:36:48.478548 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:36:48.480039 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:36:48.480758 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.context [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7421014a-aeb3-45a4-96f3-f2b361a942ff(cell1) {{(pid=109715) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 08:36:48.480875 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:36:48.482787 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:36:48.484676 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG oslo_concurrency.lockutils [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:36:48.484785 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO dbcounter [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Registered counter for database nova_cell0 Jul 25 08:36:48.486251 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG oslo_concurrency.lockutils [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:36:48.487047 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG oslo_concurrency.lockutils [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:36:48.489040 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG oslo_concurrency.lockutils [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:36:48.490704 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO dbcounter [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Registered counter for database nova_cell1 Jul 25 08:36:48.491655 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO dbcounter [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Registered counter for database nova_cell0 Jul 25 08:36:48.497085 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO dbcounter [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Registered counter for database nova_cell1 Jul 25 08:36:48.497780 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_db.sqlalchemy.engines [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:36:48.500014 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_db.sqlalchemy.engines [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:36:48.504232 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG oslo_db.sqlalchemy.engines [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:36:48.504970 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writer thread running {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:36:48.507664 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writer thread running {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:36:48.507971 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG oslo_db.sqlalchemy.engines [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:36:48.509517 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writer thread running {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:36:48.647760 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO dbcounter [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Registered counter for database nova_cell0 Jul 25 08:36:48.647992 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writer thread running {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:36:48.656210 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_db.sqlalchemy.engines [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:36:48.656726 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO dbcounter [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Registered counter for database nova_cell0 Jul 25 08:36:48.660834 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writer thread running {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:36:48.665613 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG oslo_db.sqlalchemy.engines [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:36:48.670286 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writer thread running {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:36:48.991988 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: WARNING keystonemiddleware.auth_token [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 08:36:48.993907 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: WARNING keystonemiddleware.auth_token [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 08:36:48.999248 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: WARNING keystonemiddleware.auth_token [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 08:36:49.001036 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: WARNING keystonemiddleware.auth_token [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 08:36:49.338362 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: WARNING keystonemiddleware.auth_token [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 08:36:49.342062 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: WARNING keystonemiddleware.auth_token [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 08:36:49.344304 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: WARNING keystonemiddleware.auth_token [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 08:36:49.347934 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: WARNING keystonemiddleware.auth_token [None req-b17e2f69-817f-4774-a40b-45907b5a00d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 08:36:49.349617 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602fc9199c0 pid: 109714 (default app) Jul 25 08:36:49.351670 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:36:49.352859 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001718 Jul 25 08:36:49.353272 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Mon Jul 25 08:36:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:36:49.353390 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602fc9199c0 pid: 109715 (default app) Jul 25 08:38:03.804252 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:03.805291 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 25 08:38:03.805677 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:38:03.818454 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_api:SELECT=3 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:03.819839 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_cell0:SELECT=3 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:03.821043 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_cell1:SELECT=3 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:03.821877 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:04.674598 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-13280d42-7ddc-4b4c-ab48-744da7e1e8ba admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:04.706633 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-13280d42-7ddc-4b4c-ab48-744da7e1e8ba admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.894021 Jul 25 08:38:04.717337 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Mon Jul 25 08:38:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:38:06.886290 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:06.887293 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-e6ed59d4-c79b-491c-9c2b-10112809e49f None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 25 08:38:06.887687 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:07.366876 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-70538a41-fd42-4a35-9daa-29d888b1c72d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 256}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:07.387321 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:38:07.387321 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: warnings.warn(msg) Jul 25 08:38:07.416515 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-70538a41-fd42-4a35-9daa-29d888b1c72d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.521887 Jul 25 08:38:07.418386 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Mon Jul 25 08:38:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:38:07.655383 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-3853dd60-a84e-4c2b-b897-06905542240f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:07.660626 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:38:07.660626 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: warnings.warn(msg) Jul 25 08:38:07.663712 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writing DB stats nova_api:SELECT=3 {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:07.664727 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writing DB stats nova_cell1:SELECT=3 {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:07.665877 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writing DB stats nova_cell0:SELECT=3 {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:07.666880 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:07.730719 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-3853dd60-a84e-4c2b-b897-06905542240f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.303830 Jul 25 08:38:07.731403 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Mon Jul 25 08:38:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:38:09.961999 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-70538a41-fd42-4a35-9daa-29d888b1c72d admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:09.963566 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-70538a41-fd42-4a35-9daa-29d888b1c72d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Jul 25 08:38:09.964112 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:10.860038 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-c8f0715b-2c6d-4c91-a522-c8f8079a2374 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "id": "d1"}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:10.880531 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:38:10.880531 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: warnings.warn(msg) Jul 25 08:38:10.902371 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-c8f0715b-2c6d-4c91-a522-c8f8079a2374 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.931515 Jul 25 08:38:10.903454 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Mon Jul 25 08:38:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:38:10.915688 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-f9471ca1-76ed-4f88-bf05-4d78481d48c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:10.918716 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:38:10.918716 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: warnings.warn(msg) Jul 25 08:38:10.960866 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-f9471ca1-76ed-4f88-bf05-4d78481d48c9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048817 Jul 25 08:38:10.961825 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Mon Jul 25 08:38:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:38:13.133938 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-c8f0715b-2c6d-4c91-a522-c8f8079a2374 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:13.134978 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-c8f0715b-2c6d-4c91-a522-c8f8079a2374 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 25 08:38:13.135382 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:13.542025 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-61c61960-f584-42d1-b600-58c1cab0da68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "disk": 10, "swap": 0, "id": "d2"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:13.560536 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-61c61960-f584-42d1-b600-58c1cab0da68 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419250 Jul 25 08:38:13.561406 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Mon Jul 25 08:38:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:38:13.574090 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-1e713f05-0a17-4b24-a157-37b1ff7a6daf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:13.598322 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-1e713f05-0a17-4b24-a157-37b1ff7a6daf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028470 Jul 25 08:38:13.598882 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Mon Jul 25 08:38:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:38:15.785597 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-61c61960-f584-42d1-b600-58c1cab0da68 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:15.786538 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-61c61960-f584-42d1-b600-58c1cab0da68 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 25 08:38:15.786937 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:16.212176 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-88fc10ca-42f8-4a71-ac56-cf597c76525f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:16.244358 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-88fc10ca-42f8-4a71-ac56-cf597c76525f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451794 Jul 25 08:38:16.249555 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Mon Jul 25 08:38:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:38:16.262523 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-08580d4b-27bf-430c-91cd-6bd3ba156ab5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:16.298878 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-08580d4b-27bf-430c-91cd-6bd3ba156ab5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040898 Jul 25 08:38:16.300186 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Mon Jul 25 08:38:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:38:18.488465 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-88fc10ca-42f8-4a71-ac56-cf597c76525f admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:18.489500 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-88fc10ca-42f8-4a71-ac56-cf597c76525f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 25 08:38:18.489895 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:18.919983 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-3ea1c225-462d-49ff-bc51-ff1e045a4d13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:18.939535 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-3ea1c225-462d-49ff-bc51-ff1e045a4d13 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443765 Jul 25 08:38:18.940244 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Mon Jul 25 08:38:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:38:18.952962 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-02f08701-76e9-4195-8f9a-202e3b296f97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:18.977738 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-02f08701-76e9-4195-8f9a-202e3b296f97 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029109 Jul 25 08:38:18.978470 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Mon Jul 25 08:38:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:38:21.439347 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-3ea1c225-462d-49ff-bc51-ff1e045a4d13 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:21.440740 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-3ea1c225-462d-49ff-bc51-ff1e045a4d13 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Jul 25 08:38:21.441476 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:21.868667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-7180f4d5-c658-4c8d-b5b0-2182a39cf651 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:21.894306 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-7180f4d5-c658-4c8d-b5b0-2182a39cf651 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.445706 Jul 25 08:38:21.894850 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Mon Jul 25 08:38:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:38:24.249867 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-3ea1c225-462d-49ff-bc51-ff1e045a4d13 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:24.251269 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-3ea1c225-462d-49ff-bc51-ff1e045a4d13 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jul 25 08:38:24.251762 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:24.681175 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-4a3ec2ed-1cca-47f3-bdb1-7cc938206888 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:24.699799 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-4a3ec2ed-1cca-47f3-bdb1-7cc938206888 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.442147 Jul 25 08:38:24.700387 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Mon Jul 25 08:38:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:38:24.714588 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-b666d6d2-de22-4de0-b4c8-2300f1f02416 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:24.745056 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-b666d6d2-de22-4de0-b4c8-2300f1f02416 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035397 Jul 25 08:38:24.745782 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Mon Jul 25 08:38:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:38:26.962547 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-4a3ec2ed-1cca-47f3-bdb1-7cc938206888 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:26.963548 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-4a3ec2ed-1cca-47f3-bdb1-7cc938206888 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 25 08:38:26.964104 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:27.356905 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-9813766f-132f-4bf5-9d0b-e6f7c239806f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:27.375426 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-9813766f-132f-4bf5-9d0b-e6f7c239806f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.405749 Jul 25 08:38:27.375980 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Mon Jul 25 08:38:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:38:27.388047 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-9d4eeb5c-2455-4aab-a452-f7dc36e2b92e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:27.413269 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-9d4eeb5c-2455-4aab-a452-f7dc36e2b92e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028856 Jul 25 08:38:27.414005 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Mon Jul 25 08:38:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:38:29.594666 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-9813766f-132f-4bf5-9d0b-e6f7c239806f admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:29.595757 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-9813766f-132f-4bf5-9d0b-e6f7c239806f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 25 08:38:29.596143 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:29.982621 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-7ff093d5-2393-4051-8246-53e8f0f7e82b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:30.004565 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-7ff093d5-2393-4051-8246-53e8f0f7e82b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.402437 Jul 25 08:38:30.005463 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Mon Jul 25 08:38:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:38:30.017853 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-1ce15684-8342-4c1a-9d2a-74878f2bc7e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:30.042448 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-1ce15684-8342-4c1a-9d2a-74878f2bc7e6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028658 Jul 25 08:38:30.043265 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Mon Jul 25 08:38:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:38:32.333893 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-7ff093d5-2393-4051-8246-53e8f0f7e82b admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:32.335046 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-7ff093d5-2393-4051-8246-53e8f0f7e82b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jul 25 08:38:32.335446 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:32.769130 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-457d1065-4a20-48ec-9131-bddd222783d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:32.788314 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-457d1065-4a20-48ec-9131-bddd222783d3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446320 Jul 25 08:38:32.789092 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Mon Jul 25 08:38:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:38:32.801012 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-3de922ea-9abc-43cf-b9da-ac50c7e59225 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:32.826459 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-3de922ea-9abc-43cf-b9da-ac50c7e59225 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029579 Jul 25 08:38:32.840599 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Mon Jul 25 08:38:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:38:35.053135 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-457d1065-4a20-48ec-9131-bddd222783d3 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:35.054140 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-457d1065-4a20-48ec-9131-bddd222783d3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 25 08:38:35.056658 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:35.533884 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-db868031-0c9d-4de8-89c0-a00c634e44e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "id": "5", "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:35.560294 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-db868031-0c9d-4de8-89c0-a00c634e44e8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.499267 Jul 25 08:38:35.561108 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Mon Jul 25 08:38:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 08:38:35.573251 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-41bb9fdd-13cc-4038-935a-4b99dfdc2206 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:38:35.579615 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:35.604602 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-41bb9fdd-13cc-4038-935a-4b99dfdc2206 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034895 Jul 25 08:38:35.605415 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Mon Jul 25 08:38:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:38:55.163001 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-db868031-0c9d-4de8-89c0-a00c634e44e8 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:55.164003 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-db868031-0c9d-4de8-89c0-a00c634e44e8 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 25 08:38:55.164404 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:38:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:55.175187 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:55.551386 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-3dfba7ca-aa7d-4a60-81a2-8b38e065c113 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:55.569916 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-3dfba7ca-aa7d-4a60-81a2-8b38e065c113 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399603 Jul 25 08:38:55.570390 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Mon Jul 25 08:38:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:38:56.621542 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-db868031-0c9d-4de8-89c0-a00c634e44e8 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:56.622569 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-db868031-0c9d-4de8-89c0-a00c634e44e8 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 25 08:38:56.622963 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:38:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:57.141373 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-77b484c2-7456-4e74-8c73-69c110a1ee69 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:57.146978 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.wsgi [None req-77b484c2-7456-4e74-8c73-69c110a1ee69 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-77b484c2-7456-4e74-8c73-69c110a1ee69 admin admin] Request method failure captured: Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Accept: application/json Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Accept-Encoding: gzip, deflate Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Connection: keep-alive Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Content-Length: 0 Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Host: 10.222.0.52 Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Openstack-Api-Version: compute 2.90 Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Openstack-System-Scope: None Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: User-Agent: python-novaclient Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Auth-Token: gAAAAABi3lagLumMEt59YByv79vZs2JstWFnzbTzFYWdTBQMjK20PP-1tgIzCH6KvBFkGd7FcX4d0JQ0p9v0neMoc21XuXRV8puWVhS9gr1ehHXbB2dZzzhubKNC95FWy9pOJ1aIbX3ctL4e4RTrcRdbxitf2j-l07XantjRiC1GiSN1Dqa7sGo Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Domain-Id: None Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Domain-Name: None Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Identity-Status: Confirmed Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Is-Admin-Project: True Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Domain-Id: default Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Domain-Name: Default Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Name: admin Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Role: admin,member,reader Jul 25 08:38:57.150335 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Roles: admin,member,reader Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e86d2d432f134fa4aeaa99c3935e4c0c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}] Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Tenant: admin Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Tenant-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Tenant-Name: admin Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User: admin Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Domain-Id: default Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Domain-Name: Default Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Id: fcb4950bc93048a891412be785f132b7 Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Name: admin Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: method: > Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: exception: Flavor 42 could not be found. Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: action_args: {'id': '42'} Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:38:57.151902 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:38:57.152863 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:38:57.153949 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-77b484c2-7456-4e74-8c73-69c110a1ee69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:38:57.155111 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-77b484c2-7456-4e74-8c73-69c110a1ee69 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387892 Jul 25 08:38:57.155111 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Jul 25 08:38:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 08:38:57.162156 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-3282ab62-b926-431d-b3b3-dd76fbcb5aed admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:57.166285 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:38:57.187137 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-3282ab62-b926-431d-b3b3-dd76fbcb5aed admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029308 Jul 25 08:38:57.187688 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Jul 25 08:38:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:38:57.197254 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-d6588521-ff73-452c-b368-01d004c523f7 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:57.220965 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-d6588521-ff73-452c-b368-01d004c523f7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027225 Jul 25 08:38:57.221491 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Jul 25 08:38:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:38:57.230762 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-3eda2261-4ff1-4adb-bc7b-078d30ce9e7d admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:57.237662 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.wsgi [None req-3eda2261-4ff1-4adb-bc7b-078d30ce9e7d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-3eda2261-4ff1-4adb-bc7b-078d30ce9e7d admin admin] Request method failure captured: Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Accept: application/json Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Accept-Encoding: gzip, deflate Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Connection: keep-alive Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Content-Length: 0 Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Host: 10.222.0.52 Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Openstack-Api-Version: compute 2.90 Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Openstack-System-Scope: None Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: User-Agent: python-novaclient Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Auth-Token: gAAAAABi3lagLumMEt59YByv79vZs2JstWFnzbTzFYWdTBQMjK20PP-1tgIzCH6KvBFkGd7FcX4d0JQ0p9v0neMoc21XuXRV8puWVhS9gr1ehHXbB2dZzzhubKNC95FWy9pOJ1aIbX3ctL4e4RTrcRdbxitf2j-l07XantjRiC1GiSN1Dqa7sGo Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Domain-Id: None Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Domain-Name: None Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Identity-Status: Confirmed Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Is-Admin-Project: True Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Domain-Id: default Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Domain-Name: Default Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Name: admin Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Role: admin,member,reader Jul 25 08:38:57.240974 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Roles: admin,member,reader Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e86d2d432f134fa4aeaa99c3935e4c0c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}] Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Tenant: admin Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Tenant-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Tenant-Name: admin Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User: admin Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Domain-Id: default Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Domain-Name: Default Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Id: fcb4950bc93048a891412be785f132b7 Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Name: admin Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: method: > Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: exception: Flavor 42 could not be found. Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: action_args: {'id': '42'} Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:38:57.242484 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:38:57.243396 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:38:57.244830 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-3eda2261-4ff1-4adb-bc7b-078d30ce9e7d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:38:57.246023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-3eda2261-4ff1-4adb-bc7b-078d30ce9e7d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015123 Jul 25 08:38:57.246023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Jul 25 08:38:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 08:38:58.195608 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-d6588521-ff73-452c-b368-01d004c523f7 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:58.196639 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-d6588521-ff73-452c-b368-01d004c523f7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 25 08:38:58.197040 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:38:58.718350 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-ac9aa06b-d5e6-4283-959f-fb2daa33cfd3 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:58.724130 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.wsgi [None req-ac9aa06b-d5e6-4283-959f-fb2daa33cfd3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-ac9aa06b-d5e6-4283-959f-fb2daa33cfd3 admin admin] Request method failure captured: Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Accept: application/json Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Accept-Encoding: gzip, deflate Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Connection: keep-alive Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Content-Length: 0 Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Host: 10.222.0.52 Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Openstack-Api-Version: compute 2.90 Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Openstack-System-Scope: None Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: User-Agent: python-novaclient Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Auth-Token: gAAAAABi3lai0-m8w6VRiyXMf75_HTrjBxX94LenKvQD8YJ-QKkCoA1pNxKyGBnqQLh9RryMUKXeN_suNJarPdKJ12Zw5MzuXapo5VKVKNMogaYZJ0cAqQa8b7YBav-aFHOR3OxQOWPx6B9Pu8F8sZVHbKvyeGA3VxTzCfxQbJN_UnRWamKhaeg Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Domain-Id: None Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Domain-Name: None Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Identity-Status: Confirmed Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Is-Admin-Project: True Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Domain-Id: default Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Domain-Name: Default Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Name: admin Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Role: admin,member,reader Jul 25 08:38:58.725667 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Roles: admin,member,reader Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e86d2d432f134fa4aeaa99c3935e4c0c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}] Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Tenant: admin Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Tenant-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Tenant-Name: admin Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User: admin Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Domain-Id: default Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Domain-Name: Default Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Id: fcb4950bc93048a891412be785f132b7 Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Name: admin Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: method: > Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: exception: Flavor 84 could not be found. Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: action_args: {'id': '84'} Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:38:58.727109 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:38:58.728023 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:38:58.729386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-ac9aa06b-d5e6-4283-959f-fb2daa33cfd3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:38:58.732466 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-ac9aa06b-d5e6-4283-959f-fb2daa33cfd3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392399 Jul 25 08:38:58.733078 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Jul 25 08:38:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 08:38:58.742805 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-2eb3e6a4-984a-4d5d-b359-e33573551bde admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:58.757649 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-2eb3e6a4-984a-4d5d-b359-e33573551bde admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018360 Jul 25 08:38:58.758164 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Jul 25 08:38:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:38:58.767550 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-bdd7856e-304a-4112-b3cc-262dead24144 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:58.784847 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-bdd7856e-304a-4112-b3cc-262dead24144 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020740 Jul 25 08:38:58.785375 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Jul 25 08:38:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:38:58.794251 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-fca16bf3-6d64-4d09-af3f-9ba7eb1a27e0 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:58.800019 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.wsgi [None req-fca16bf3-6d64-4d09-af3f-9ba7eb1a27e0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-fca16bf3-6d64-4d09-af3f-9ba7eb1a27e0 admin admin] Request method failure captured: Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Accept: application/json Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Accept-Encoding: gzip, deflate Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Connection: keep-alive Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Content-Length: 0 Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Host: 10.222.0.52 Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Openstack-Api-Version: compute 2.90 Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Openstack-System-Scope: None Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: User-Agent: python-novaclient Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Auth-Token: gAAAAABi3lai0-m8w6VRiyXMf75_HTrjBxX94LenKvQD8YJ-QKkCoA1pNxKyGBnqQLh9RryMUKXeN_suNJarPdKJ12Zw5MzuXapo5VKVKNMogaYZJ0cAqQa8b7YBav-aFHOR3OxQOWPx6B9Pu8F8sZVHbKvyeGA3VxTzCfxQbJN_UnRWamKhaeg Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Domain-Id: None Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Domain-Name: None Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Identity-Status: Confirmed Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Is-Admin-Project: True Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Domain-Id: default Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Domain-Name: Default Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Name: admin Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Role: admin,member,reader Jul 25 08:38:58.801528 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Roles: admin,member,reader Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e86d2d432f134fa4aeaa99c3935e4c0c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}] Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Tenant: admin Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Tenant-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Tenant-Name: admin Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User: admin Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Domain-Id: default Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Domain-Name: Default Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Id: fcb4950bc93048a891412be785f132b7 Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Name: admin Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: method: > Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: exception: Flavor 84 could not be found. Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: action_args: {'id': '84'} Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:38:58.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:38:58.804125 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:38:58.805551 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-fca16bf3-6d64-4d09-af3f-9ba7eb1a27e0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:38:58.806777 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-fca16bf3-6d64-4d09-af3f-9ba7eb1a27e0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012077 Jul 25 08:38:58.806777 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Jul 25 08:38:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 08:38:59.759534 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-bdd7856e-304a-4112-b3cc-262dead24144 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:38:59.760547 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-bdd7856e-304a-4112-b3cc-262dead24144 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 25 08:38:59.760978 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:38:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:39:00.277974 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-67b862c6-eee6-4bb3-bd6f-f23e9e1b4068 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:00.284143 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.wsgi [None req-67b862c6-eee6-4bb3-bd6f-f23e9e1b4068 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-67b862c6-eee6-4bb3-bd6f-f23e9e1b4068 admin admin] Request method failure captured: Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Accept: application/json Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Accept-Encoding: gzip, deflate Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Connection: keep-alive Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Content-Length: 0 Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Host: 10.222.0.52 Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Openstack-Api-Version: compute 2.90 Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Openstack-System-Scope: None Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: User-Agent: python-novaclient Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Auth-Token: gAAAAABi3lajeJ-rXEWW7f1pgtKMkMjMyUfFjoWEnuVw-ZrXvfxi7aYzKVhfhQOfhSUJBayFJbaKCaH29aHT_6dTGTbgAREWByDKwqvZI6uqb_Q3ZqDLdAbY-h1PC98nXAPZ1q6GQiejwkV0De9liiwEBjXC6bTF05MWv66EfClK-3r3xvclljM Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Domain-Id: None Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Domain-Name: None Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Identity-Status: Confirmed Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Is-Admin-Project: True Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Domain-Id: default Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Domain-Name: Default Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Project-Name: admin Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Role: admin,member,reader Jul 25 08:39:00.285652 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Roles: admin,member,reader Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e86d2d432f134fa4aeaa99c3935e4c0c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}] Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Tenant: admin Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Tenant-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-Tenant-Name: admin Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User: admin Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Domain-Id: default Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Domain-Name: Default Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Id: fcb4950bc93048a891412be785f132b7 Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: X-User-Name: admin Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: method: > Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: exception: Flavor 451 could not be found. Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: action_args: {'id': '451'} Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:39:00.287211 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:39:00.288166 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 25 08:39:00.289494 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-67b862c6-eee6-4bb3-bd6f-f23e9e1b4068 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:39:00.290983 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-67b862c6-eee6-4bb3-bd6f-f23e9e1b4068 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388193 Jul 25 08:39:00.290983 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Jul 25 08:38:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 08:39:00.301104 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-5b4b1cd7-bf99-48a3-98dd-44867e4616a2 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:00.316105 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-5b4b1cd7-bf99-48a3-98dd-44867e4616a2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019178 Jul 25 08:39:00.316647 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Jul 25 08:39:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:39:00.326113 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:00.340796 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018184 Jul 25 08:39:00.341317 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Jul 25 08:39:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:39:00.350739 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-edf4cbbb-9fc8-48c8-8ccf-ca8c98b92268 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:00.355943 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.wsgi [None req-edf4cbbb-9fc8-48c8-8ccf-ca8c98b92268 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-edf4cbbb-9fc8-48c8-8ccf-ca8c98b92268 admin admin] Request method failure captured: Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Accept: application/json Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Accept-Encoding: gzip, deflate Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Connection: keep-alive Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Content-Length: 0 Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Host: 10.222.0.52 Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Openstack-Api-Version: compute 2.90 Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Openstack-System-Scope: None Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: User-Agent: python-novaclient Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Auth-Token: gAAAAABi3lajeJ-rXEWW7f1pgtKMkMjMyUfFjoWEnuVw-ZrXvfxi7aYzKVhfhQOfhSUJBayFJbaKCaH29aHT_6dTGTbgAREWByDKwqvZI6uqb_Q3ZqDLdAbY-h1PC98nXAPZ1q6GQiejwkV0De9liiwEBjXC6bTF05MWv66EfClK-3r3xvclljM Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Domain-Id: None Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Domain-Name: None Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Identity-Status: Confirmed Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Is-Admin-Project: True Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Domain-Id: default Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Domain-Name: Default Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Project-Name: admin Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Role: admin,member,reader Jul 25 08:39:00.357455 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Roles: admin,member,reader Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e86d2d432f134fa4aeaa99c3935e4c0c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e86d2d432f134fa4aeaa99c3935e4c0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e86d2d432f134fa4aeaa99c3935e4c0c"}]}] Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Tenant: admin Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Tenant-Id: e86d2d432f134fa4aeaa99c3935e4c0c Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-Tenant-Name: admin Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User: admin Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Domain-Id: default Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Domain-Name: Default Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Id: fcb4950bc93048a891412be785f132b7 Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: X-User-Name: admin Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: method: > Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: exception: Flavor 451 could not be found. Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: action_args: {'id': '451'} Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:39:00.359050 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:39:00.361244 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: ERROR nova.api.openstack.wsgi Jul 25 08:39:00.362590 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-edf4cbbb-9fc8-48c8-8ccf-ca8c98b92268 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:39:00.363838 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-edf4cbbb-9fc8-48c8-8ccf-ca8c98b92268 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011529 Jul 25 08:39:00.363838 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Jul 25 08:39:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 08:39:01.309548 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:01.310548 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 25 08:39:01.310932 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:39:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:39:01.830334 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-6cd19da6-83e5-4343-83e4-6b0da656df95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:39:01.849248 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-6cd19da6-83e5-4343-83e4-6b0da656df95 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401666 Jul 25 08:39:01.849773 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Jul 25 08:39:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:39:02.815268 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:02.816257 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 25 08:39:02.816678 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:39:03.335606 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-14ae67d8-391a-4bc8-8584-6c4e9fef967a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:39:03.354740 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-14ae67d8-391a-4bc8-8584-6c4e9fef967a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.402282 Jul 25 08:39:03.355279 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Jul 25 08:39:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 08:39:04.318386 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:04.319380 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 25 08:39:04.319793 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:39:04.844223 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-bc388898-4cf3-427d-ad8f-0230bd43cf63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:39:04.864376 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-bc388898-4cf3-427d-ad8f-0230bd43cf63 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406633 Jul 25 08:39:04.864963 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Jul 25 08:39:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:39:05.824017 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:05.825053 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 25 08:39:05.825455 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:39:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:39:06.339717 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-6317cd75-fa60-4ed0-aeb4-240a60aff6bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:39:06.358392 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-6317cd75-fa60-4ed0-aeb4-240a60aff6bd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.396149 Jul 25 08:39:06.359323 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Jul 25 08:39:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:39:07.318304 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:07.319331 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 25 08:39:07.319728 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:39:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:39:07.841902 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-4f7ce7ef-e6dc-4569-8166-ecd41b704f16 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:07.862819 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-4f7ce7ef-e6dc-4569-8166-ecd41b704f16 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405846 Jul 25 08:39:07.863386 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Mon Jul 25 08:39:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:39:58.451735 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:58.452768 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-479a7b40-f6a4-405d-9a8b-350358f27b27 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 25 08:39:58.453157 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Mon Jul 25 08:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:39:58.463471 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:58.835433 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-06e71c3f-4cf6-4b42-899c-69a9ce3fd0a4 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:58.856282 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-06e71c3f-4cf6-4b42-899c-69a9ce3fd0a4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397210 Jul 25 08:39:58.856848 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Mon Jul 25 08:39:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:39:58.879323 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-ab0ff8ae-11c8-4297-86f6-83c598ba63fa admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:58.882676 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_api:SELECT=14 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:39:58.888450 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-ab0ff8ae-11c8-4297-86f6-83c598ba63fa admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012491 Jul 25 08:39:58.888978 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Mon Jul 25 08:39:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:39:58.900675 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-aa722b6a-a6d5-49c7-bdaf-c78f4d553bdb admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:58.908767 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-aa722b6a-a6d5-49c7-bdaf-c78f4d553bdb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011616 Jul 25 08:39:58.909274 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Mon Jul 25 08:39:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:39:58.920117 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-cf3f2e3e-ed11-4e1a-9c2f-9a15af6d0f73 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:58.927598 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-cf3f2e3e-ed11-4e1a-9c2f-9a15af6d0f73 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010891 Jul 25 08:39:58.928108 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Mon Jul 25 08:39:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:39:58.939398 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-caf6e306-5322-45ce-872b-22a2355d9f92 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:39:58.946779 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-caf6e306-5322-45ce-872b-22a2355d9f92 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011278 Jul 25 08:39:58.947278 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Mon Jul 25 08:39:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:43:41.290502 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-cf3f2e3e-ed11-4e1a-9c2f-9a15af6d0f73 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:43:41.291935 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-cf3f2e3e-ed11-4e1a-9c2f-9a15af6d0f73 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002331 Jul 25 08:43:41.292331 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:43:41.439942 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writing DB stats nova_api:SELECT=6 {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:41.597260 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-c587a870-f30c-49f3-b871-a1986d36c98a admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:43:41.599567 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:43:41.599567 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: warnings.warn(msg) Jul 25 08:43:41.600798 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-c587a870-f30c-49f3-b871-a1986d36c98a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:43:41.601241 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-c587a870-f30c-49f3-b871-a1986d36c98a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:43:41.602030 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-c587a870-f30c-49f3-b871-a1986d36c98a admin admin] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:43:41.602464 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-c587a870-f30c-49f3-b871-a1986d36c98a admin admin] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:43:41.635653 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-c587a870-f30c-49f3-b871-a1986d36c98a admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197172 Jul 25 08:43:41.636206 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Jul 25 08:43:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:43:42.488864 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-cf3f2e3e-ed11-4e1a-9c2f-9a15af6d0f73 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:43:42.489899 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-cf3f2e3e-ed11-4e1a-9c2f-9a15af6d0f73 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 25 08:43:42.490294 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:43:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:43:42.681499 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-89f856e8-afcc-4646-bd50-2cbc4c13eb5d admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:43:42.683890 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:43:42.683890 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: warnings.warn(msg) Jul 25 08:43:42.685147 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-89f856e8-afcc-4646-bd50-2cbc4c13eb5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:43:42.685594 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-89f856e8-afcc-4646-bd50-2cbc4c13eb5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:43:42.687024 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-89f856e8-afcc-4646-bd50-2cbc4c13eb5d admin admin] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:43:42.687486 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-89f856e8-afcc-4646-bd50-2cbc4c13eb5d admin admin] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:43:42.706666 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-89f856e8-afcc-4646-bd50-2cbc4c13eb5d admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077064 Jul 25 08:43:42.707224 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Jul 25 08:43:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:43:53.889042 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-cf3f2e3e-ed11-4e1a-9c2f-9a15af6d0f73 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:43:53.890043 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-cf3f2e3e-ed11-4e1a-9c2f-9a15af6d0f73 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Jul 25 08:43:53.890440 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:43:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:43:54.033767 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writing DB stats nova_cell0:SELECT=4 {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:54.034471 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writing DB stats nova_cell1:SELECT=4 {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:54.035146 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG dbcounter [-] [109714] Writing DB stats nova_api:SELECT=8 {{(pid=109714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:54.084834 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-f6deee25-6aff-41ad-b81c-90ee93f7eec8 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:43:54.088081 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:43:54.088081 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: warnings.warn(msg) Jul 25 08:43:54.089644 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-f6deee25-6aff-41ad-b81c-90ee93f7eec8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:43:54.090333 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-f6deee25-6aff-41ad-b81c-90ee93f7eec8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:43:54.091569 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-f6deee25-6aff-41ad-b81c-90ee93f7eec8 admin admin] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:43:54.092130 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-f6deee25-6aff-41ad-b81c-90ee93f7eec8 admin admin] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:43:54.120659 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-f6deee25-6aff-41ad-b81c-90ee93f7eec8 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091645 Jul 25 08:43:54.121151 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Jul 25 08:43:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:43:54.938201 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-cf3f2e3e-ed11-4e1a-9c2f-9a15af6d0f73 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:43:54.939720 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-cf3f2e3e-ed11-4e1a-9c2f-9a15af6d0f73 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 25 08:43:54.940117 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Jul 25 08:43:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:43:55.128991 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG nova.api.openstack.wsgi [None req-d0618825-feb2-41f1-bac5-e21e3a6d9fb1 admin admin] Calling method '>' {{(pid=109714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:43:55.131355 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:43:55.131355 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: warnings.warn(msg) Jul 25 08:43:55.132556 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-d0618825-feb2-41f1-bac5-e21e3a6d9fb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:43:55.133056 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-d0618825-feb2-41f1-bac5-e21e3a6d9fb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:43:55.133875 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-d0618825-feb2-41f1-bac5-e21e3a6d9fb1 admin admin] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:43:55.134307 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: DEBUG oslo_concurrency.lockutils [None req-d0618825-feb2-41f1-bac5-e21e3a6d9fb1 admin admin] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:43:55.155758 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: INFO nova.api.openstack.requestlog [None req-d0618825-feb2-41f1-bac5-e21e3a6d9fb1 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078077 Jul 25 08:43:55.156242 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: [pid: 109714|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Jul 25 08:43:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:44:52.761013 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: Mon Jul 25 08:44:52 2022 - graceful shutdown triggered... Jul 25 08:44:52.761507 dv-cinder-850840-1-iscsi devstack@n-api.service[109714]: Gracefully killing worker 1 (pid: 109714)... Jul 25 08:44:52.761042 dv-cinder-850840-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 08:44:52.762573 dv-cinder-850840-1-iscsi devstack@n-api.service[109715]: Gracefully killing worker 2 (pid: 109715)... Jul 25 08:44:53.762087 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: worker 1 buried after 1 seconds Jul 25 08:44:53.762859 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: worker 2 buried after 1 seconds Jul 25 08:44:53.762859 dv-cinder-850840-1-iscsi devstack@n-api.service[109713]: goodbye to uWSGI. Jul 25 08:44:53.763947 dv-cinder-850840-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 25 08:44:53.764525 dv-cinder-850840-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 08:44:53.767364 dv-cinder-850840-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 08:44:53.777785 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 08:44:53 2022] *** Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: nodename: dv-cinder-850840-1-iscsi Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: machine: x86_64 Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: clock source: unix Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: pcre jit disabled Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: detected number of CPU cores: 4 Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: current working directory: / Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: detected binary path: /usr/bin/uwsgi-core Jul 25 08:44:53.780458 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: your processes number limit is 47680 Jul 25 08:44:53.781536 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: your memory page size is 4096 bytes Jul 25 08:44:53.781536 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: detected max file descriptor number: 2048 Jul 25 08:44:53.781536 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: lock engine: pthread robust mutexes Jul 25 08:44:53.781536 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: thunder lock: enabled Jul 25 08:44:53.781536 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 08:44:53.781536 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 08:44:53.820707 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: Python main interpreter initialized at 0x5606cfd2d9c0 Jul 25 08:44:53.820707 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: python threads support enabled Jul 25 08:44:53.820707 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: your server socket listen backlog is limited to 100 connections Jul 25 08:44:53.820707 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: your mercy for graceful operations on workers is 90 seconds Jul 25 08:44:53.821163 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 08:44:53.821163 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: *** Operational MODE: preforking *** Jul 25 08:44:53.821408 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: *** uWSGI is running in multiple interpreter mode *** Jul 25 08:44:53.821408 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: spawned uWSGI master process (pid: 124220) Jul 25 08:44:53.821613 dv-cinder-850840-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 08:44:53.822180 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: spawned uWSGI worker 1 (pid: 124234, cores: 1) Jul 25 08:44:53.822724 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: spawned uWSGI worker 2 (pid: 124235, cores: 1) Jul 25 08:44:53.823028 dv-cinder-850840-1-iscsi devstack@n-api.service[124220]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 08:44:54.481849 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 08:44:54.482444 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 08:44:55.635368 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:44:55.635368 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: from cryptography.utils import int_from_bytes Jul 25 08:44:55.635982 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:44:55.635982 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: from cryptography.utils import int_from_bytes Jul 25 08:44:55.636131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:44:55.636131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: from cryptography.utils import int_from_bytes Jul 25 08:44:55.636559 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:44:55.636559 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: from cryptography.utils import int_from_bytes Jul 25 08:44:58.030419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 08:44:58.031047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 08:44:58.031138 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 08:44:58.031532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 08:44:58.031741 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 08:44:58.032138 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.032469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.032761 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 08:44:58.033157 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.033244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 08:44:58.033825 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.034007 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.034111 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 08:44:58.034313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.034429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 08:44:58.034647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.034755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 08:44:58.034974 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.035083 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.035316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.035417 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.035578 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.036320 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.036417 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.036504 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.036639 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850840-1-iscsi {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.036729 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.036811 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.036884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.036963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.037053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.037325 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.037435 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.037585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.037680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.037822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.037936 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.038118 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.038230 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.038444 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850840-1-iscsi {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.038549 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.038772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.039014 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.040416 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.040552 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.040660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.040756 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.040842 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.040916 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.040998 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.041071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.041142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.041142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.041293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.041378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.041462 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.041545 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.041627 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.041942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.042071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.042154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.042233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.042468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.042594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.043303 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.043434 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850840-1-iscsi {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.043514 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.043594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.043675 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.043763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.043837 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.043916 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.043996 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.044267 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.044392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.044609 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.044739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850840-1-iscsi {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.044929 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.045155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.045417 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.045668 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.045878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.046115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.046360 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.046587 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.046826 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.047051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.047264 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.047487 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.047698 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.047922 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.048158 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.048389 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.048616 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.048942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.049671 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.049827 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.050023 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.050171 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.050351 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.050509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.050668 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.050830 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.051038 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.051235 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.051403 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.051560 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.051708 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.051863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.052034 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.052189 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.052343 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.052507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.052507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.052863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.053016 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.053179 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.053179 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.053468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.053615 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.053773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.053928 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.054333 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.054499 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.054656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.054656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.054966 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.055132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.055290 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.055446 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.055605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.055762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.055921 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.056075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.056231 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.056385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.056546 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.056730 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.056886 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.057043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.057191 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.057345 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.057501 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.057648 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.057793 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.057952 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.058106 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.058254 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.058410 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.058563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.058716 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.058863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.059018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.059172 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.059329 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.059485 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.059631 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.059778 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.059934 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.060091 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.060238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.060385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.060539 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.060746 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.060896 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.061068 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.061217 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.061376 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.061523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.061669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.061823 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.061980 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.062126 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.062272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.062425 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.062580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.062726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.062960 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.063119 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.063275 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.063275 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.063579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.063736 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.063892 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.064039 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.064212 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.064610 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.064770 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.064937 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.065085 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.065251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.065399 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.065546 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.065692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.065852 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.066000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.066154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.066314 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.066462 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.066608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.066763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.066910 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.067056 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.067223 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.067379 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.067533 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.067691 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.067838 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.067984 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.068130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.068283 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.068449 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.068630 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.068783 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.068939 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.069094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.069258 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.069420 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.069568 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.069723 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.069887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.070035 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.070189 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.070351 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.070498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.070651 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.070808 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.070964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.071120 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.071285 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.071454 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.071609 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.071756 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.071912 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.072059 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.072219 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.072366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.072520 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.072700 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.072848 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.073006 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.073167 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.073325 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.073480 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.073636 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.073792 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.073958 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.073958 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.074267 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.074440 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.074781 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.074943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.075105 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.075261 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.075426 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.075574 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.075720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.075866 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.076030 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.076185 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.076332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.076478 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.076655 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.076818 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.076985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.077133 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.077330 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.077503 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.077659 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.077816 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.077971 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.078118 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.078264 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.078410 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.078563 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.078724 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.078871 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.079025 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.079180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.079335 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.079502 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.079664 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.079812 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.079958 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.080103 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.080797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:44:58.080946 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.081106 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.081263 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.081421 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.081587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.081746 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.081919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.082074 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.082222 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.082369 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.082517 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.082663 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.082818 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.082966 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.083120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.083275 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.083431 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.083578 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.083739 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.083911 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.084067 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.084222 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.084222 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.084523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.084929 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.085084 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.085230 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.085387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.085544 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.085692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.085846 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.086015 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.086171 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.086331 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.086487 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.086635 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.086799 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.086954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.087272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.087434 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.087584 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.087741 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.087904 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.088060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.088222 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.088222 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.088555 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.088745 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.089129 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.089129 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.089390 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.089390 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.089651 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.089777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.089970 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.090825 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.090992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.091150 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.091313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.091474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.091630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.091785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.091949 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.092105 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.092253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.092407 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.092563 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.092748 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.092957 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.093113 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.093298 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.093463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.093611 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.093772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.093921 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.094076 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.094232 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.094387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.094534 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.094696 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.095317 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.095500 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.095659 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.096347 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.096753 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.096961 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.097144 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.097302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.097302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.097591 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.097747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.097904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.098055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.098214 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.098362 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.098516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.098672 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.098829 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.098991 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.099147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.099295 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.099441 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.099602 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.099750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.099897 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.100043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.100209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.100356 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.100517 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.100703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.100853 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.101000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.101157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.101157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.101463 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.101713 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.101868 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.102023 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.102170 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.102339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.102488 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.102635 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.102780 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.102935 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.103082 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.103238 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.103386 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.103541 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.103696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.103845 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.103999 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.104155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.104321 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.104469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.104709 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.104940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.105326 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.105544 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.105705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.105849 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.106123 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.106292 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.106459 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.106608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.106781 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.106932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.107081 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.107234 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.107234 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.107525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.107669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.107820 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.107964 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.108107 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.108258 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.108258 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.108537 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.108705 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.108851 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.109004 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.109156 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.109299 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.109439 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.109530 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.109673 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.109780 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.109875 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.109970 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.110058 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.110152 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.110246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.110342 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.110342 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.110523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.110611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.110704 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.110848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.110996 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.111130 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.111261 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.111377 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.111469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.111555 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.111656 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.111744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.111837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.111923 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112015 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112204 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112289 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112382 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112470 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112562 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112709 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112799 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112885 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.112971 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.113109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.113208 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.113316 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.113406 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.113406 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.113571 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.113657 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.113749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.113848 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.113943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.114039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.114132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.114132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.114311 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.114406 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.114504 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.114590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.114775 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.114872 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.114970 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.115058 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.115151 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.115417 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.115512 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.115598 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.115693 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.115781 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.115876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.115964 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.115964 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.116127 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.116127 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.116294 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.116294 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.116459 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.116552 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.116720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.116896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.116987 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117166 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117258 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117358 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117358 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117531 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117711 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117805 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.117988 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.118123 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.118123 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.118340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.118431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.118532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.118619 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.118705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.118797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.118898 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.118992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.119095 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.119189 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.119277 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.119362 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.119456 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.119680 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.119787 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.119992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.120097 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.120315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.120413 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.120650 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.120763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.120974 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.121119 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.121282 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.121385 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.121595 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.121694 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.121926 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.122047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.122262 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.122367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.122573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.122677 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.122888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.122990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.123214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.123316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.123525 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.123629 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.123837 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.123934 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.124151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.124261 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.124461 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.124556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.124800 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.124948 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.125105 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.125273 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.125453 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.125671 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.125830 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.125974 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.126120 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.126277 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.126424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.126566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.126717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.126860 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.127030 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.127180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.127346 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.127492 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.127643 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.127805 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.127952 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.128092 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.128226 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.128354 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.128519 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.128679 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.128858 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.128984 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.129173 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.129296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.129488 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.129610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.129798 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.129936 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.130114 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.130243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.130424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.130547 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.130735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.130859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.131043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.131165 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.131352 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.131482 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.131684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.131807 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.131995 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.132117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.132460 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.132787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.133115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.133429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.133695 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.133843 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.134047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.134203 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.134338 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.134476 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.134670 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.134809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.134987 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.135134 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.135300 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.135437 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.135612 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.135839 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.135991 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.136125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.136257 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.136390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.136522 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.136686 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.136959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.137330 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.137521 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.137657 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.137835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.137973 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.138151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.138275 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.138474 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.138609 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.138797 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.138955 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.139119 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.139263 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.139441 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.139721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.139859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.140059 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.140205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.140378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.140523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.140719 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.140855 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.141039 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.141184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.141339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.141475 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.141660 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.141798 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.141989 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.142125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.142330 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.142590 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.143251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.143446 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.143591 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.143736 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.143877 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.144044 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.144191 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.144359 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.144497 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.144699 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.144838 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.145010 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.145151 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.145317 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.145454 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.145631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.145783 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.146005 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.146155 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.146299 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.146511 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.146654 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.146795 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.146929 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.147069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.147202 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.147345 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.147486 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.147626 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.147760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.147891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.148023 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.148165 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.148299 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.148432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.148615 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.148770 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.148915 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.149057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.149217 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.149363 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.149506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.149668 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.149854 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.149991 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.150164 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.150301 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.150508 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.150647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.150844 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.150989 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.151188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.151326 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.151497 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.151636 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.151804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.151940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.152116 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.152253 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.152419 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.152564 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.152761 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.152910 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.153066 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.153212 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.153378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.153595 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.153740 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.153874 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.154017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.154158 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.154291 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.154433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.154575 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.154708 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.154874 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.155011 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.155184 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.155323 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.155489 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.155628 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.155798 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.155942 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.156169 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.156307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.156439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.156622 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.156772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.156907 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.157054 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.157188 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.157367 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.157513 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.157785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.157937 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.158082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.158216 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.158894 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.159031 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.159173 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.159315 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.159450 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.159592 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.159733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.159873 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.160007 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.160149 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.160289 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.160430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.160585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.160721 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.160866 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.161016 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.161158 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.161291 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.161447 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.161585 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.161777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.161930 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.162111 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.162248 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.162418 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.162556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.162724 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.162871 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.163033 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.163170 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.163340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.163486 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.163629 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.163772 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.163941 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.164080 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.164263 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.164409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.164620 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.164764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.164898 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.165030 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.165211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.165349 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.165501 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.165642 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.165810 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.165946 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.166117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.166346 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.166493 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.166634 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.166767 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.166908 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.167041 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.167189 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.167332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.167465 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.167604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.167738 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.167878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.168029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.168163 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.168305 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.168463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.168640 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.168788 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.168936 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.169099 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.169233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.169376 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.169516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.169708 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.169859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.170018 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.170156 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.170341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.170479 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.170652 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.170789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.170978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.171113 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.171287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.171423 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.171598 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.171743 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.171907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.172043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.172213 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.172348 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.172546 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.172725 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.172861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.172994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.173126 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.173266 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.173443 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.173590 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.173749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.173934 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.174126 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.174303 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.174446 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.174588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.174747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.174892 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.175062 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.175209 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.175387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.175532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.175715 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.175852 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.176032 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.176191 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.176341 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.176553 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.176738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.176881 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.177015 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.177157 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.177291 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.177423 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.177563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.177888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.178040 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.178182 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.178315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.178463 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.178596 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.178728 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.178876 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.179009 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.179142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.179282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.179422 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.179555 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.179701 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.179922 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.180058 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.180233 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.180371 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.180539 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.180716 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.180931 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.181068 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.181247 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.181391 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.181554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.181691 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.181869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.182006 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.182177 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.182313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.182534 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.182668 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.182799 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.182928 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.183169 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.183312 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.183488 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.183633 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.183802 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.183936 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.184107 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.184250 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.184422 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.184565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.184823 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.184972 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.185116 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.185260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.185401 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.185540 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.185681 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.185820 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.185962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.186104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.186369 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.186521 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.186735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.186881 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.187024 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.187172 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.187306 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.187438 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.187570 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.187702 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.187861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.188009 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.188189 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.188327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.188498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.188665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.188837 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.188983 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.189146 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.189286 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.189487 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.189636 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.189807 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.189946 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.190132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.190269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.190505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.190649 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.190821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.190967 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.191140 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.191277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.191474 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.191611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.191789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.191935 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.192103 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.192241 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.192415 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.192563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.192763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.192905 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.193071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.193208 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.193396 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.193547 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.193715 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.193853 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.194029 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.194174 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.194355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.194501 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.194685 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.194830 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.194998 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.195150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.195314 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.195453 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.195621 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.195757 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.195945 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.196099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.196271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.196409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.196606 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.196778 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.196992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.197140 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.197307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.197447 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.197638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.197784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.197946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.198092 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.198272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.198411 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.198591 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.198727 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.198875 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.199016 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.199184 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.199322 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.199497 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.199635 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.199804 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.199942 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.200112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.200258 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.200436 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.200589 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.200778 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.200918 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.201093 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.201238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.201390 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.201539 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.201700 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.201839 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.202004 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.202142 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.202309 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.202460 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.202632 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.202777 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.202939 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.203077 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.203262 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.203409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.203577 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.203724 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.203901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.204040 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.204224 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.204430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.204621 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.204771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.204905 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.205047 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.205682 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.205826 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.205959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.206101 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.206273 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.206410 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.206580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.206717 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.206906 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.207207 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.207207 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.207466 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.207614 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.207749 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.207882 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.208020 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.208153 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.208284 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.208462 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.208635 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.208806 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.208945 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.209123 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.209276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.209425 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.209567 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.209735 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.209873 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.210070 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.210215 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.210379 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.210527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.210684 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.210823 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.210996 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.211143 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.211349 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.211668 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.212010 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.212147 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.212344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.212498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.212691 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.212831 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.213005 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.213173 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.213322 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.213473 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.213622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.213765 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.213906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.214047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.214213 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.214351 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.214523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.214660 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.214830 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.214977 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.215123 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.215257 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.215441 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.215580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.215777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.215912 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.216061 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.216202 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.216342 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.216474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.216672 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.216827 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.216985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.217147 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.217362 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.217507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.217624 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.217746 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.217907 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.218055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.218219 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.218357 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.218528 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.218681 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.218849 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.218992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.219166 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.219303 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.219485 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.219632 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.219803 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.219940 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.220120 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.220258 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.220435 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.220605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.220821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.221454 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.221627 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.221764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.221950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.222096 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.222269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.222412 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.222587 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.222723 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.222904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.223131 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.223277 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.223465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.223603 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.223783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.223936 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.224100 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.224231 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.224416 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.224554 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.224762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.224897 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.225066 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.225204 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.225385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.225605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.225827 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.225971 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.226115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.226256 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.226397 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.226538 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.226681 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.226852 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.226998 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.227174 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.227334 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.227548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.227694 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.227829 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.227970 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.228112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.228245 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.228387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.228520 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.228720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.228867 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.229056 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.229194 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.229386 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.229525 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.229720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.229864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.230034 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.230181 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.230353 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.230490 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.230672 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.230810 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.230987 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.231139 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.231289 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.231430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.231600 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.231737 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.231915 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.232061 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.232228 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.232373 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.232539 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.232755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.232907 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.233041 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.233199 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.233345 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.233517 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.233656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.233834 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.233981 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.234161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.234306 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.234481 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.234701 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.234826 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.234964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.235087 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.235217 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.235406 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.235611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.235750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.235931 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.236077 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.236267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.236425 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.236644 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.236789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.236977 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.237123 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.237298 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.237438 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.237652 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.237791 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.237948 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.238159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.238297 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.238480 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.238635 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.238821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.238960 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.239149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.239293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.239457 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.239605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.239782 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.239920 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.240097 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.240239 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.240405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.240544 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.240751 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.240886 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.241066 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.241217 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.241384 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.241602 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.241739 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.241957 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.242100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.242280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.242418 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.242611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.242755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.242917 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.243051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.243244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.243379 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.243558 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.243694 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.243887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.244108 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.244254 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.244532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.244713 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.244861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.244996 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.245138 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.245278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.245437 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.245582 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.245748 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.245886 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.246063 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.246209 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.246378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.246515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.246684 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.246829 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.246998 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.247135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.247301 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.247437 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.247631 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.247847 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.247994 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.248127 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.248259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.248392 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.248524 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.248693 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.248829 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.248969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.249135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.249274 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.249442 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.249589 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.249730 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.249870 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.250042 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.250181 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.250358 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.250506 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.250647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.250780 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.250959 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.251105 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.251265 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.251413 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.251578 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.251716 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.251884 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.252039 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.252221 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.252366 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.252530 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.252689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.252873 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.253018 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.253185 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.253316 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.253495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.253630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.253815 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.253960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.254153 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.254297 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.254467 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.254618 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.254818 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.254963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.255105 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.255237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.255438 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.255574 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.255750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.255900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.256060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.256295 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.256433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.256661 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.256795 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.256991 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.257136 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.257327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.257472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.257661 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.257821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.258036 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.258174 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.258307 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.258438 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.258579 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.258878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.259023 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.259196 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.259334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.259511 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.259649 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.259828 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.259966 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.260144 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.260282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.260459 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.260617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.260795 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.260941 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.261110 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.261255 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.261422 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.261565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.261719 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.261864 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.262035 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.262447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.262618 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.262771 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.262932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.263077 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.263244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.263382 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.263559 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.263705 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.263878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.264017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.264205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.264350 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.264521 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.264823 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.265034 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.265177 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.265317 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.265439 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.265569 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.265699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.265815 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.265945 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.266076 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.266206 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.266350 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.266482 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.266657 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.266793 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.266990 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.267136 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.267306 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.267450 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.268103 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.268322 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.268460 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.268612 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.268766 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.268901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.269073 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.269211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.269391 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.269538 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.269716 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.269866 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.270055 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.270195 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.270375 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.270526 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.270687 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.270823 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.271011 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.271150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.271326 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.271478 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.271658 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.271804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.271998 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.272137 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.272331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.272474 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.272679 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.272829 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.272993 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.273138 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.273288 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.273422 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.273597 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.273735 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.273909 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.274047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.274240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.274423 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.274559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.274699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.274839 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.274999 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.275199 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.275346 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.275488 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.275629 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.275762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.275893 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.276032 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.276173 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.276307 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.276439 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.276631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.276781 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.276916 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.277045 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.277220 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.277359 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.277527 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.277678 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.277819 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.277953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.278127 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.278286 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.278501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.278644 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.278785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.278916 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.279055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.279194 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.279339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.279473 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.279604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.279735 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.279874 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.280014 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.280180 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.280325 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.280606 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.280754 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.280887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.281032 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.281220 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.281359 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.281540 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.281674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.281851 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.281997 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.282164 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.282299 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.282472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.282608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.282783 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.282929 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.283096 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.283260 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.283977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.284115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.284325 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.284472 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.284669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.284807 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.285001 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.285136 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.285358 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.285508 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.285661 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.285797 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.285938 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.286068 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.286213 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.286348 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.286503 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.286642 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.286815 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.286952 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.287142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.287279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.287468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.287599 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.287777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.287917 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.288109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.288232 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.288423 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.289418 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.289553 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.289683 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.289798 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.289798 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.290020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.290133 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.290246 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.290367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.290367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.290623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.290623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.290834 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.290946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.291078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.291193 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.291314 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.291507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.291639 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.291823 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.291975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.295806 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.295990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.296139 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.296295 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.296447 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.296664 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.296664 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.296939 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.297090 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.297221 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.297365 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.297499 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.297640 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.297772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.297911 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.298130 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.298266 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.298399 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.298530 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.298662 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.298793 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.298973 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.299108 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.299249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.299408 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.299544 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.299684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.299831 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.299973 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.300107 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.300246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.300469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.300469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.300821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.300939 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 08:44:58.301060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.301060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.301060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.301060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.301060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.301060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:44:58.301060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 08:44:58.358906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO dbcounter [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Registered counter for database nova_api Jul 25 08:44:58.360981 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO dbcounter [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Registered counter for database nova_api Jul 25 08:44:58.378859 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_db.sqlalchemy.engines [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:44:58.380749 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_db.sqlalchemy.engines [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:44:58.385756 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writer thread running {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:44:58.387554 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writer thread running {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:44:58.443033 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.context [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7421014a-aeb3-45a4-96f3-f2b361a942ff(cell1) {{(pid=124235) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 08:44:58.444552 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.context [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7421014a-aeb3-45a4-96f3-f2b361a942ff(cell1) {{(pid=124234) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 08:44:58.447140 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:44:58.448684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:44:58.448816 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:44:58.449530 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:44:58.450267 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:44:58.451090 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:44:58.451503 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:44:58.453092 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:44:58.453700 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO dbcounter [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Registered counter for database nova_cell0 Jul 25 08:44:58.455864 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO dbcounter [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Registered counter for database nova_cell0 Jul 25 08:44:58.458491 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO dbcounter [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Registered counter for database nova_cell1 Jul 25 08:44:58.459956 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO dbcounter [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Registered counter for database nova_cell1 Jul 25 08:44:58.466018 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_db.sqlalchemy.engines [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:44:58.468199 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_db.sqlalchemy.engines [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:44:58.469288 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_db.sqlalchemy.engines [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:44:58.471964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_db.sqlalchemy.engines [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:44:58.476679 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writer thread running {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:44:58.477905 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writer thread running {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:44:58.479241 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writer thread running {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:44:58.618521 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writer thread running {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:44:58.627292 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO dbcounter [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Registered counter for database nova_cell0 Jul 25 08:44:58.629075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO dbcounter [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Registered counter for database nova_cell0 Jul 25 08:44:58.634431 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_db.sqlalchemy.engines [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:44:58.635946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_db.sqlalchemy.engines [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:44:58.639643 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writer thread running {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:44:58.640594 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writer thread running {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:44:58.956912 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: WARNING keystonemiddleware.auth_token [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 08:44:58.959958 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: WARNING keystonemiddleware.auth_token [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 08:44:58.964690 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: WARNING keystonemiddleware.auth_token [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 08:44:58.967731 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: WARNING keystonemiddleware.auth_token [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 08:44:59.307071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: WARNING keystonemiddleware.auth_token [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 08:44:59.310602 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: WARNING keystonemiddleware.auth_token [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 08:44:59.313128 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: WARNING keystonemiddleware.auth_token [None req-5c34c9aa-8227-492b-8474-aaad18a781ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 08:44:59.317182 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: WARNING keystonemiddleware.auth_token [None req-18748664-e9d6-44e6-be56-7dae668a80f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 08:44:59.319020 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5606cfd2d9c0 pid: 124234 (default app) Jul 25 08:44:59.322509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5606cfd2d9c0 pid: 124235 (default app) Jul 25 08:45:43.981094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a24f68c6-5bee-4f18-847a-460cfdc3c86d tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f7bac70d0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:45:44.077023 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=3 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:44.078358 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=3 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:44.079774 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=3 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:44.080954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=3 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:44.815226 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a24f68c6-5bee-4f18-847a-460cfdc3c86d tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5b287201-3fcc-49a4-81e9-9c8e16ab98fe" status: 200 len: 350 microversion: 2.1 time: 1.511064 Jul 25 08:45:44.816646 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 1/1] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:45:43 2022] GET /compute/v2.1/os-volumes/5b287201-3fcc-49a4-81e9-9c8e16ab98fe => generated 350 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:45:46.721880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:46.723692 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:46.726109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:46.729107 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:45:47.242610 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-75275271-7533-4c10-9cd8-b12dd2f23d27 tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f7ba0c160>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:45:48.253077 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-75275271-7533-4c10-9cd8-b12dd2f23d27 tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e86bda52-54ff-4203-ba2f-0bf462cb3380" status: 200 len: 351 microversion: 2.1 time: 1.534531 Jul 25 08:45:48.255267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:45:46 2022] GET /compute/v2.1/os-volumes/e86bda52-54ff-4203-ba2f-0bf462cb3380 => generated 351 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:45:52.409257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9657a926-7d14-4492-9027-02ad7deec656 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'create', calling method: .version_select at 0x7f0f7c26aa60>, body: {"keypair": {"name": "tempest-keypair-2022515460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBOFCStl372jVnVep1BGpthr1uz1C8/jP0G8NfdreD/OMxpiBJQ12QG/+j/OYfit37akuRHQGiRhW6cTZ+jqG+YYsE8vtn6t53JINL3qwFuaFCqbAsf0e24PZZyykcA9g=="}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:45:52.577313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-9657a926-7d14-4492-9027-02ad7deec656 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Getting quotas for project 9313fe06660f4049be47f901c3fc6f76. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:45:52.605715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-9657a926-7d14-4492-9027-02ad7deec656 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Getting quotas for user 718ca333456f4de5b98f191ab40cca0b and project 9313fe06660f4049be47f901c3fc6f76. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:45:52.729672 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9657a926-7d14-4492-9027-02ad7deec656 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.595097 Jul 25 08:45:52.730803 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Jul 25 08:45:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:45:52.753547 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1878862690", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:45:52.916286 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] validate_networks() for [('2d9d4ebf-a640-4736-9377-d7ebfc6f53b2', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:45:54.387915 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:45:54.390422 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:45:54.392149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:45:54.392783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:45:54.393425 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:45:54.464431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:45:54.465207 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:45:54.467743 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:45:54.494698 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:45:54.568497 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Getting quotas for project 7e61cbb537384f549eee9ec4c92d9d77. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:45:54.577497 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Getting quotas for user 238f78244df546e5a6fc1a4cd1b73288 and project 7e61cbb537384f549eee9ec4c92d9d77. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:45:54.595022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:45:54.599241 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:45:54.753580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f10b72dd-0813-41b2-91d3-d1bd42838d8c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.160079 Jul 25 08:45:54.754660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 2/4] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:45:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:45:54.767739 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b08b6506-e242-444b-83c4-b3b4430415a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:45:54.769087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b08b6506-e242-444b-83c4-b3b4430415a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:45:55.088041 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b08b6506-e242-444b-83c4-b3b4430415a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:45:55.122969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b08b6506-e242-444b-83c4-b3b4430415a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1222 microversion: 2.1 time: 0.359164 Jul 25 08:45:55.124226 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:45:54 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1222 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:45:55.513346 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2036693513", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:45:55.670148 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] validate_networks() for [('2d9d4ebf-a640-4736-9377-d7ebfc6f53b2', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:45:56.865271 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1ef56486-34c6-4212-850f-b8727a4b1b9e tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f7afe5160>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:45:57.019209 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1ef56486-34c6-4212-850f-b8727a4b1b9e tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6da69241-656a-448a-aaca-13799fb0ed5f" status: 200 len: 351 microversion: 2.1 time: 0.163151 Jul 25 08:45:57.029432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 4/6] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:45:56 2022] GET /compute/v2.1/os-volumes/6da69241-656a-448a-aaca-13799fb0ed5f => generated 351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:45:57.399078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-891993999", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "networks": [{"uuid": "fab9b340-d5f0-4d1e-9134-d3f67a8942d8"}]}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:45:57.634777 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.network.neutron [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] validate_networks() for [('fab9b340-d5f0-4d1e-9134-d3f67a8942d8', None, None, None, None, None)] {{(pid=124234) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:45:58.167320 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:45:58.167816 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:45:58.168200 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:45:58.168637 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:45:58.169059 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:45:58.184184 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:45:58.186897 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:45:58.189972 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:45:58.191426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:45:58.242977 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Getting quotas for project 7e61cbb537384f549eee9ec4c92d9d77. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:45:58.247736 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Getting quotas for user 238f78244df546e5a6fc1a4cd1b73288 and project 7e61cbb537384f549eee9ec4c92d9d77. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:45:58.270835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:45:58.273130 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:45:58.390878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f7c4fc50-1a9d-43b8-9679-96e5a877bfd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.894007 Jul 25 08:45:58.394550 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 3/7] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:45:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:45:58.403721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a1a052da-893f-4030-b4a4-5fc3955a98f7 tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f7afb2b80>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:45:58.617976 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a1a052da-893f-4030-b4a4-5fc3955a98f7 tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.221701 Jul 25 08:45:58.619107 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1134 bytes} [Mon Jul 25 08:45:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:45:58.747457 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2e230be2-5ebe-4dfd-b821-b4d76d9b68d5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: .version_select at 0x7f0f7afb29d0>, body: {"keypair": {"name": "tempest-keypair-221134369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9pudlVhH6+nLp7OKq8kwSuCqJMSUmavOK/BtTSazln9M9UEkPlvbL+r3FIIugzBznF12OVVdMrBXLDGo5l9C7HnIV0/2bT7PKJMUX3X68JBxFr0iRUIGv05a5xj/gDyw=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:45:58.825978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-2e230be2-5ebe-4dfd-b821-b4d76d9b68d5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:45:58.838908 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-2e230be2-5ebe-4dfd-b821-b4d76d9b68d5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for user 8e682232b7374450a7265e092602a5a6 and project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:45:58.921141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2e230be2-5ebe-4dfd-b821-b4d76d9b68d5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.300388 Jul 25 08:45:58.931838 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 5/9] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Jul 25 08:45:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:45:58.938338 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d2904e73-dce7-452a-b4b2-4f94372f5e4d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:45:58.939422 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d2904e73-dce7-452a-b4b2-4f94372f5e4d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:45:59.272772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d2904e73-dce7-452a-b4b2-4f94372f5e4d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:45:59.305970 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d2904e73-dce7-452a-b4b2-4f94372f5e4d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1222 microversion: 2.1 time: 0.372505 Jul 25 08:45:59.317665 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 6/10] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:45:58 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1222 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:45:59.333928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-25239425-716e-4243-9e6a-9f1c18ec937d tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f7afb25e0>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:45:59.561885 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-25239425-716e-4243-9e6a-9f1c18ec937d tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.242885 Jul 25 08:45:59.562517 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 7/11] 10.222.0.52 () {58 vars in 1149 bytes} [Mon Jul 25 08:45:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:45:59.576846 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1035521522", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3560e9df-9e9b-4cf9-8b14-5afa8bdd3245"}], "security_groups": [{"name": "tempest-securitygroup--1835060495"}], "key_name": "tempest-keypair-2022515460", "user_data": "}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:45:59.991558 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] validate_networks() for [('3560e9df-9e9b-4cf9-8b14-5afa8bdd3245', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:46:00.269560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Flavor limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:46:00.270385 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Image limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:46:00.270852 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Flavor pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:46:00.271400 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Image pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:46:00.271937 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:46:00.289665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:00.290634 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:00.293408 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:00.294852 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:00.354293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Getting quotas for project aa18cc0817c848a782e4176af753e3e8. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:46:00.361878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Getting quotas for user bc39f30010e94eb5862285347575f673 and project aa18cc0817c848a782e4176af753e3e8. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:46:00.378409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Going to run 1 instances... {{(pid=124234) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:46:00.381766 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124234) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:46:00.540174 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6f4487f2-a3fe-4dd8-acbd-9b50b9bba310 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.507336 Jul 25 08:46:00.540952 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 5/12] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:45:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:46:00.573198 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7117ac32-5848-462e-9d05-da0a5cbc5f59 tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f7af78700>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:00.852767 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7117ac32-5848-462e-9d05-da0a5cbc5f59 tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.309319 Jul 25 08:46:00.853636 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 6/13] 10.222.0.52 () {58 vars in 1134 bytes} [Mon Jul 25 08:46:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:00.858686 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-deb999ac-e2c6-43f3-ad28-37a443c0b31d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:00.859488 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-deb999ac-e2c6-43f3-ad28-37a443c0b31d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:00.916047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-deb999ac-e2c6-43f3-ad28-37a443c0b31d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:00.917961 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-deb999ac-e2c6-43f3-ad28-37a443c0b31d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:00.932996 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-deb999ac-e2c6-43f3-ad28-37a443c0b31d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:00.934729 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-deb999ac-e2c6-43f3-ad28-37a443c0b31d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:01.857723 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-deb999ac-e2c6-43f3-ad28-37a443c0b31d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:01.897015 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-deb999ac-e2c6-43f3-ad28-37a443c0b31d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1282 microversion: 2.1 time: 1.042017 Jul 25 08:46:01.921143 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 7/14] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:00 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1282 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:01.930013 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a2f55ef2-0ca8-44cd-967a-21053e143325 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:01.933002 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a2f55ef2-0ca8-44cd-967a-21053e143325 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:01.942542 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a2f55ef2-0ca8-44cd-967a-21053e143325 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:01.943297 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a2f55ef2-0ca8-44cd-967a-21053e143325 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:01.946516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a2f55ef2-0ca8-44cd-967a-21053e143325 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:01.947730 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a2f55ef2-0ca8-44cd-967a-21053e143325 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:02.313986 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a2f55ef2-0ca8-44cd-967a-21053e143325 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:02.329410 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a2f55ef2-0ca8-44cd-967a-21053e143325 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1218 microversion: 2.1 time: 0.398501 Jul 25 08:46:02.330292 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 8/15] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:01 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1218 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:02.335171 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9281c6d4-8676-40e8-8a8b-9d9f51ce53ab tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f79efeee0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:02.583260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9281c6d4-8676-40e8-8a8b-9d9f51ce53ab tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.251696 Jul 25 08:46:02.584416 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 9/16] 10.222.0.52 () {58 vars in 1167 bytes} [Mon Jul 25 08:46:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:02.598018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ae887835-4caa-4309-a84f-350b6121e3be tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f79e61b80>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:02.931253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ae887835-4caa-4309-a84f-350b6121e3be tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.337361 Jul 25 08:46:02.931965 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 10/17] 10.222.0.52 () {58 vars in 1170 bytes} [Mon Jul 25 08:46:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:02.937992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dc0eb945-98d0-4a87-b52f-171526426526 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:02.938623 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dc0eb945-98d0-4a87-b52f-171526426526 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:02.970376 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc0eb945-98d0-4a87-b52f-171526426526 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:02.970800 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc0eb945-98d0-4a87-b52f-171526426526 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:02.971743 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc0eb945-98d0-4a87-b52f-171526426526 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:02.972252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc0eb945-98d0-4a87-b52f-171526426526 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:03.450992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dc0eb945-98d0-4a87-b52f-171526426526 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:03.476842 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dc0eb945-98d0-4a87-b52f-171526426526 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1280 microversion: 2.1 time: 0.540321 Jul 25 08:46:03.481746 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 11/18] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:02 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1280 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:03.523306 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8386ca2b-57a3-40c4-812a-99264f80971d tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f79e61430>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:03.951583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8386ca2b-57a3-40c4-812a-99264f80971d tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.468159 Jul 25 08:46:03.953316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 12/19] 10.222.0.52 () {58 vars in 1155 bytes} [Mon Jul 25 08:46:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:03.959013 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9081c49b-dae4-4f74-b152-195899ce9d42 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:03.959837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9081c49b-dae4-4f74-b152-195899ce9d42 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:03.992674 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9081c49b-dae4-4f74-b152-195899ce9d42 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:03.996898 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9081c49b-dae4-4f74-b152-195899ce9d42 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:03.998751 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9081c49b-dae4-4f74-b152-195899ce9d42 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:04.000386 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9081c49b-dae4-4f74-b152-195899ce9d42 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:04.067696 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:46:04.069058 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:46:04.070281 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:46:04.071274 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:46:04.072787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:46:04.099858 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:04.104799 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:04.121123 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:04.128980 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:04.200637 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Getting quotas for project 9313fe06660f4049be47f901c3fc6f76. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:46:04.207317 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Getting quotas for user 718ca333456f4de5b98f191ab40cca0b and project 9313fe06660f4049be47f901c3fc6f76. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:46:04.224278 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:46:04.228137 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:46:04.405766 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cc18cb6c-13e8-44dc-a050-a072c7794b5c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.833854 Jul 25 08:46:04.410611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 8/20] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:45:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 4848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:46:04.417020 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9081c49b-dae4-4f74-b152-195899ce9d42 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:04.429934 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ee8c69e6-7c20-4d4a-93cb-e81e431ced9b tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f7a775ee0>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:04.434765 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9081c49b-dae4-4f74-b152-195899ce9d42 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1272 microversion: 2.1 time: 0.479565 Jul 25 08:46:04.439679 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 13/21] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:03 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1272 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:04.472003 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0379ccf9-d97e-494b-a428-3de9ce5a7cfb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:04.477726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0379ccf9-d97e-494b-a428-3de9ce5a7cfb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:04.721521 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ee8c69e6-7c20-4d4a-93cb-e81e431ced9b tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.309568 Jul 25 08:46:04.722192 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 9/22] 10.222.0.52 () {58 vars in 1188 bytes} [Mon Jul 25 08:46:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:04.733854 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a8df87c4-b638-4643-83f5-5de09e8aa716 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:04.734531 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a8df87c4-b638-4643-83f5-5de09e8aa716 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:04.751641 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8df87c4-b638-4643-83f5-5de09e8aa716 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:04.766627 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8df87c4-b638-4643-83f5-5de09e8aa716 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:04.780714 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8df87c4-b638-4643-83f5-5de09e8aa716 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:04.782108 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8df87c4-b638-4643-83f5-5de09e8aa716 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:05.351360 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0379ccf9-d97e-494b-a428-3de9ce5a7cfb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:05.389443 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0379ccf9-d97e-494b-a428-3de9ce5a7cfb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1238 microversion: 2.1 time: 0.945441 Jul 25 08:46:05.413138 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 14/23] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:04 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1238 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:05.429670 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a9f1428c-352b-402d-980b-b4ddb45b845b tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] Calling method '.version_select at 0x7f0f79e9ef70>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:05.742282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a9f1428c-352b-402d-980b-b4ddb45b845b tempest-VolumesTestJSON-1011269826 tempest-VolumesTestJSON-1011269826-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.327977 Jul 25 08:46:05.743022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 15/24] 10.222.0.52 () {58 vars in 1155 bytes} [Mon Jul 25 08:46:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:05.763055 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bf0fb8f7-d381-4959-ad00-67a182f23650 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:05.768384 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bf0fb8f7-d381-4959-ad00-67a182f23650 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:05.806777 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf0fb8f7-d381-4959-ad00-67a182f23650 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:05.807237 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf0fb8f7-d381-4959-ad00-67a182f23650 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:05.808033 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf0fb8f7-d381-4959-ad00-67a182f23650 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:05.808497 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf0fb8f7-d381-4959-ad00-67a182f23650 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:05.840104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a8df87c4-b638-4643-83f5-5de09e8aa716 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:05.893191 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a8df87c4-b638-4643-83f5-5de09e8aa716 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1280 microversion: 2.1 time: 1.164933 Jul 25 08:46:05.899046 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 10/25] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:04 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1280 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:06.414229 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bb1a007d-f902-4e45-9450-f8bbbeae9f21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:06.414852 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bb1a007d-f902-4e45-9450-f8bbbeae9f21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:06.435264 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bb1a007d-f902-4e45-9450-f8bbbeae9f21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:06.435718 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bb1a007d-f902-4e45-9450-f8bbbeae9f21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:06.436521 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bb1a007d-f902-4e45-9450-f8bbbeae9f21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:06.437064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bb1a007d-f902-4e45-9450-f8bbbeae9f21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:06.557940 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bf0fb8f7-d381-4959-ad00-67a182f23650 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:06.567894 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bf0fb8f7-d381-4959-ad00-67a182f23650 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1272 microversion: 2.1 time: 0.812994 Jul 25 08:46:06.579595 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 16/26] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:05 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1272 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:06.922031 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-37883ac6-8214-481f-b0a9-8f6e58eaa2fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:06.922649 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-37883ac6-8214-481f-b0a9-8f6e58eaa2fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:06.939720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-37883ac6-8214-481f-b0a9-8f6e58eaa2fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:06.940177 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-37883ac6-8214-481f-b0a9-8f6e58eaa2fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:06.943599 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-37883ac6-8214-481f-b0a9-8f6e58eaa2fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:06.945961 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-37883ac6-8214-481f-b0a9-8f6e58eaa2fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:06.956200 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bb1a007d-f902-4e45-9450-f8bbbeae9f21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:06.970154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bb1a007d-f902-4e45-9450-f8bbbeae9f21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1234 microversion: 2.1 time: 0.557261 Jul 25 08:46:06.973850 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 11/27] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:06 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1234 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:07.599709 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c3c8017d-6d21-422a-8841-a9d464e31ed1 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:07.600331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c3c8017d-6d21-422a-8841-a9d464e31ed1 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:07.615974 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3c8017d-6d21-422a-8841-a9d464e31ed1 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:07.616439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3c8017d-6d21-422a-8841-a9d464e31ed1 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:07.617296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3c8017d-6d21-422a-8841-a9d464e31ed1 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:07.617736 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3c8017d-6d21-422a-8841-a9d464e31ed1 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:08.164180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-37883ac6-8214-481f-b0a9-8f6e58eaa2fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:08.175147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-37883ac6-8214-481f-b0a9-8f6e58eaa2fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1280 microversion: 2.1 time: 1.257066 Jul 25 08:46:08.189902 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 17/28] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:06 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1280 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:08.210726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-98701496-b489-47ae-aa1b-8819c5f5824b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:08.213755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-98701496-b489-47ae-aa1b-8819c5f5824b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:08.256599 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-98701496-b489-47ae-aa1b-8819c5f5824b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:08.256599 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-98701496-b489-47ae-aa1b-8819c5f5824b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:08.256599 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-98701496-b489-47ae-aa1b-8819c5f5824b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:08.256599 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-98701496-b489-47ae-aa1b-8819c5f5824b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:08.341850 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c3c8017d-6d21-422a-8841-a9d464e31ed1 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:08.352175 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c3c8017d-6d21-422a-8841-a9d464e31ed1 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1272 microversion: 2.1 time: 0.756993 Jul 25 08:46:08.356421 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 12/29] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:07 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1272 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:08.888023 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-98701496-b489-47ae-aa1b-8819c5f5824b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:08.906159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-98701496-b489-47ae-aa1b-8819c5f5824b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1296 microversion: 2.1 time: 0.714677 Jul 25 08:46:08.907511 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 18/30] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:08 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1296 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:09.199526 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4a911d5c-cb21-4448-8761-bd3a0ea4752b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:09.200227 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4a911d5c-cb21-4448-8761-bd3a0ea4752b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:09.226632 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4a911d5c-cb21-4448-8761-bd3a0ea4752b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:09.233381 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4a911d5c-cb21-4448-8761-bd3a0ea4752b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:09.238636 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4a911d5c-cb21-4448-8761-bd3a0ea4752b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:09.239141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4a911d5c-cb21-4448-8761-bd3a0ea4752b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:09.384244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2a293a24-4d55-40db-985e-601feec8e0e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:09.387054 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2a293a24-4d55-40db-985e-601feec8e0e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:09.405822 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2a293a24-4d55-40db-985e-601feec8e0e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:09.414290 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2a293a24-4d55-40db-985e-601feec8e0e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:09.415698 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2a293a24-4d55-40db-985e-601feec8e0e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:09.416816 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2a293a24-4d55-40db-985e-601feec8e0e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:09.829434 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2a293a24-4d55-40db-985e-601feec8e0e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:09.842909 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2a293a24-4d55-40db-985e-601feec8e0e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1272 microversion: 2.1 time: 0.465260 Jul 25 08:46:09.844074 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 19/31] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:09 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1272 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:09.927489 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9a294294-9a27-4866-bffe-8a95d7cb065f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:09.928120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9a294294-9a27-4866-bffe-8a95d7cb065f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:09.940076 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a294294-9a27-4866-bffe-8a95d7cb065f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:09.940547 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a294294-9a27-4866-bffe-8a95d7cb065f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:09.943059 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a294294-9a27-4866-bffe-8a95d7cb065f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:09.946290 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a294294-9a27-4866-bffe-8a95d7cb065f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:10.339894 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:10.663147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9a294294-9a27-4866-bffe-8a95d7cb065f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:10.679304 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9a294294-9a27-4866-bffe-8a95d7cb065f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1296 microversion: 2.1 time: 0.755610 Jul 25 08:46:10.693990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 20/32] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:09 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1296 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:10.869569 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-07d886bd-94cb-4f3d-99cb-64a4fc351e43 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:10.871112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-07d886bd-94cb-4f3d-99cb-64a4fc351e43 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:10.904711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-07d886bd-94cb-4f3d-99cb-64a4fc351e43 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:10.907439 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-07d886bd-94cb-4f3d-99cb-64a4fc351e43 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:10.915920 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-07d886bd-94cb-4f3d-99cb-64a4fc351e43 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:10.919363 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-07d886bd-94cb-4f3d-99cb-64a4fc351e43 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:11.585532 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4a911d5c-cb21-4448-8761-bd3a0ea4752b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:11.594756 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4a911d5c-cb21-4448-8761-bd3a0ea4752b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 2.398737 Jul 25 08:46:11.597920 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 13/33] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:09 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:11.715022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6c44a6b8-61f1-4829-82d3-42872d480de3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:11.716465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6c44a6b8-61f1-4829-82d3-42872d480de3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:11.743236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6c44a6b8-61f1-4829-82d3-42872d480de3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:11.743717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6c44a6b8-61f1-4829-82d3-42872d480de3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:11.744558 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6c44a6b8-61f1-4829-82d3-42872d480de3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:11.745069 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6c44a6b8-61f1-4829-82d3-42872d480de3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:13.152043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-07d886bd-94cb-4f3d-99cb-64a4fc351e43 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:13.161806 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-07d886bd-94cb-4f3d-99cb-64a4fc351e43 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 2.298008 Jul 25 08:46:13.175628 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6c44a6b8-61f1-4829-82d3-42872d480de3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:13.175628 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6c44a6b8-61f1-4829-82d3-42872d480de3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1296 microversion: 2.1 time: 1.463748 Jul 25 08:46:13.178431 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 21/34] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:10 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 2316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:13.185723 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-89487e93-05a5-43c7-b760-7cae4a94392f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:13.186663 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-89487e93-05a5-43c7-b760-7cae4a94392f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:13.191131 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 14/35] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:11 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1296 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:13.200455 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89487e93-05a5-43c7-b760-7cae4a94392f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:13.201465 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89487e93-05a5-43c7-b760-7cae4a94392f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:13.202448 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89487e93-05a5-43c7-b760-7cae4a94392f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:13.204207 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89487e93-05a5-43c7-b760-7cae4a94392f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:13.656980 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1695611936", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ca11239-7898-4751-a9c6-3b03bbecba12"}], "security_groups": [{"name": "tempest-securitygroup--1752023823"}], "key_name": "tempest-keypair-221134369", "user_data": "}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:14.164556 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:14.207962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-89487e93-05a5-43c7-b760-7cae4a94392f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:14.220178 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=24 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:14.227764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-89487e93-05a5-43c7-b760-7cae4a94392f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 1.044265 Jul 25 08:46:14.240797 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 22/36] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:13 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:14.257878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-81d32eb7-83a1-4b6a-9d58-9643bed0eeea tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:14.258521 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-81d32eb7-83a1-4b6a-9d58-9643bed0eeea tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:14.281531 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:14.284446 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-81d32eb7-83a1-4b6a-9d58-9643bed0eeea tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:14.284974 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-81d32eb7-83a1-4b6a-9d58-9643bed0eeea tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:14.285710 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-81d32eb7-83a1-4b6a-9d58-9643bed0eeea tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:14.286196 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-81d32eb7-83a1-4b6a-9d58-9643bed0eeea tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:15.183763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] validate_networks() for [('6ca11239-7898-4751-a9c6-3b03bbecba12', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:46:15.385297 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=14 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:16.152825 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-81d32eb7-83a1-4b6a-9d58-9643bed0eeea tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:16.175853 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-81d32eb7-83a1-4b6a-9d58-9643bed0eeea tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 1.930769 Jul 25 08:46:16.195305 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 23/37] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:14 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:16.220641 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-490eeb3a-c07d-4b97-8652-89e771eec9df tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:16.221543 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-490eeb3a-c07d-4b97-8652-89e771eec9df tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:16.237399 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-490eeb3a-c07d-4b97-8652-89e771eec9df tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:16.238119 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-490eeb3a-c07d-4b97-8652-89e771eec9df tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:16.240725 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-490eeb3a-c07d-4b97-8652-89e771eec9df tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:16.247044 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-490eeb3a-c07d-4b97-8652-89e771eec9df tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:17.048028 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-490eeb3a-c07d-4b97-8652-89e771eec9df tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:17.059248 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-490eeb3a-c07d-4b97-8652-89e771eec9df tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.860189 Jul 25 08:46:17.060256 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 24/38] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:16 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:17.285092 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-7534f545-9dc4-4a0d-8f86-b3c76d2f3f66 req-4a663aa3-b896-49ad-bc5f-baa66bbdf1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a72735-dc04-46c8-93bb-0ac441aed151", "tag": "28a4c653-6358-4c44-a455-40a51fe64fbc"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:17.329654 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-7534f545-9dc4-4a0d-8f86-b3c76d2f3f66 req-4a663aa3-b896-49ad-bc5f-baa66bbdf1c8 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:17.330872 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-7534f545-9dc4-4a0d-8f86-b3c76d2f3f66 req-4a663aa3-b896-49ad-bc5f-baa66bbdf1c8 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:17.378124 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-7534f545-9dc4-4a0d-8f86-b3c76d2f3f66 req-4a663aa3-b896-49ad-bc5f-baa66bbdf1c8 service nova] Creating event network-changed:28a4c653-6358-4c44-a455-40a51fe64fbc for instance 71a72735-dc04-46c8-93bb-0ac441aed151 on hv-cinder-85084 Jul 25 08:46:17.378124 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-7534f545-9dc4-4a0d-8f86-b3c76d2f3f66 req-4a663aa3-b896-49ad-bc5f-baa66bbdf1c8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124234) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 08:46:17.378466 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ded93258-36a3-4578-9429-9ccb6080aac6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:17.379131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ded93258-36a3-4578-9429-9ccb6080aac6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:17.380465 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ded93258-36a3-4578-9429-9ccb6080aac6 None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:17.381805 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ded93258-36a3-4578-9429-9ccb6080aac6 None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:17.397658 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.compute.rpcapi [None req-ded93258-36a3-4578-9429-9ccb6080aac6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 08:46:17.399358 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ded93258-36a3-4578-9429-9ccb6080aac6 None None] Releasing lock "compute-rpcapi-router" {{(pid=124234) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 08:46:17.437160 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ded93258-36a3-4578-9429-9ccb6080aac6 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371838 Jul 25 08:46:17.438048 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 25/39] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:17.447157 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b2115d4a-2f0e-4c62-940d-a9e7bb6f0d13 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:17.448975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b2115d4a-2f0e-4c62-940d-a9e7bb6f0d13 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:17.461663 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b2115d4a-2f0e-4c62-940d-a9e7bb6f0d13 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:17.463095 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b2115d4a-2f0e-4c62-940d-a9e7bb6f0d13 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:17.482196 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b2115d4a-2f0e-4c62-940d-a9e7bb6f0d13 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:17.485516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b2115d4a-2f0e-4c62-940d-a9e7bb6f0d13 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:17.774519 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:46:17.776892 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:46:17.777543 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:46:17.778083 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:46:17.778621 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:46:17.781318 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=10 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:17.791232 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:17.791794 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:17.792717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:17.793229 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:17.805540 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=37 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:17.822639 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:46:17.828851 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for user 8e682232b7374450a7265e092602a5a6 and project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:46:17.842700 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:46:17.845292 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:46:17.947347 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b2115d4a-2f0e-4c62-940d-a9e7bb6f0d13 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:17.949633 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-017ff19a-5fd6-4f9e-8f8e-c17b28b57a2a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.301447 Jul 25 08:46:17.950629 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 15/40] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:46:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 4311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:46:17.955056 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b2115d4a-2f0e-4c62-940d-a9e7bb6f0d13 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.515205 Jul 25 08:46:17.955619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 26/41] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:17 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:17.973838 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0dabad66-42af-4a4e-8b0f-84ce76e98f84 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:17.974779 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0dabad66-42af-4a4e-8b0f-84ce76e98f84 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:17.986997 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0dabad66-42af-4a4e-8b0f-84ce76e98f84 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:17.987461 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0dabad66-42af-4a4e-8b0f-84ce76e98f84 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:17.988256 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0dabad66-42af-4a4e-8b0f-84ce76e98f84 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:17.988748 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0dabad66-42af-4a4e-8b0f-84ce76e98f84 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:18.446965 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-6af85c45-4453-4a5d-9d91-589fead7330b req-0e0ef6ae-318c-4390-a24b-7913b25b6cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b16067-f13e-472e-a335-bbb66b7461b1", "tag": "4e4d0870-3b4e-4551-b50c-c4f668b497de"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:18.459627 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0dabad66-42af-4a4e-8b0f-84ce76e98f84 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:18.471156 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0dabad66-42af-4a4e-8b0f-84ce76e98f84 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.514357 Jul 25 08:46:18.472341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 27/42] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:17 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:18.477512 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-357254bd-d34b-4c55-9837-ae9a2d671b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:18.478380 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-357254bd-d34b-4c55-9837-ae9a2d671b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:18.501277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-6af85c45-4453-4a5d-9d91-589fead7330b req-0e0ef6ae-318c-4390-a24b-7913b25b6cfe service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:18.501767 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-6af85c45-4453-4a5d-9d91-589fead7330b req-0e0ef6ae-318c-4390-a24b-7913b25b6cfe service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:18.599474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-6af85c45-4453-4a5d-9d91-589fead7330b req-0e0ef6ae-318c-4390-a24b-7913b25b6cfe service nova] Creating event network-changed:4e4d0870-3b4e-4551-b50c-c4f668b497de for instance 22b16067-f13e-472e-a335-bbb66b7461b1 on hv-cinder-85084 Jul 25 08:46:18.603661 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-6af85c45-4453-4a5d-9d91-589fead7330b req-0e0ef6ae-318c-4390-a24b-7913b25b6cfe service nova] Acquired lock "compute-rpcapi-router" {{(pid=124235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 08:46:18.605280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-533446f0-62d0-41d3-ad3e-7209828f2e00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:18.605741 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-533446f0-62d0-41d3-ad3e-7209828f2e00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:18.606617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-533446f0-62d0-41d3-ad3e-7209828f2e00 None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:18.607175 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-533446f0-62d0-41d3-ad3e-7209828f2e00 None None] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:18.619108 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.compute.rpcapi [None req-533446f0-62d0-41d3-ad3e-7209828f2e00 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 08:46:18.620820 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-533446f0-62d0-41d3-ad3e-7209828f2e00 None None] Releasing lock "compute-rpcapi-router" {{(pid=124235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 08:46:18.632248 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-357254bd-d34b-4c55-9837-ae9a2d671b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:18.648562 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-357254bd-d34b-4c55-9837-ae9a2d671b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1241 microversion: 2.1 time: 0.174986 Jul 25 08:46:18.664948 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 28/43] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:18 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1241 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:18.684542 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-533446f0-62d0-41d3-ad3e-7209828f2e00 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.725734 Jul 25 08:46:18.692471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fc1637fc-71a6-40c8-82db-653194a06a66 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:18.698504 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 16/44] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:18.703769 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fc1637fc-71a6-40c8-82db-653194a06a66 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:18.730739 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fc1637fc-71a6-40c8-82db-653194a06a66 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:18.734322 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fc1637fc-71a6-40c8-82db-653194a06a66 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:18.741853 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fc1637fc-71a6-40c8-82db-653194a06a66 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:18.744606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fc1637fc-71a6-40c8-82db-653194a06a66 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:18.817340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=100 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:18.979461 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-20c6c749-c473-4331-8637-07af7bb4dbdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:18.980900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-20c6c749-c473-4331-8637-07af7bb4dbdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:18.991155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20c6c749-c473-4331-8637-07af7bb4dbdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:18.991621 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20c6c749-c473-4331-8637-07af7bb4dbdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:18.992415 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20c6c749-c473-4331-8637-07af7bb4dbdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:18.992919 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20c6c749-c473-4331-8637-07af7bb4dbdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:19.044866 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fc1637fc-71a6-40c8-82db-653194a06a66 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:19.056838 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fc1637fc-71a6-40c8-82db-653194a06a66 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.390087 Jul 25 08:46:19.063782 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 29/45] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:18 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:19.180780 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-20c6c749-c473-4331-8637-07af7bb4dbdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:19.189670 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-20c6c749-c473-4331-8637-07af7bb4dbdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.214516 Jul 25 08:46:19.190699 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 17/46] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:18 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:19.492663 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9f20dd7c-5f12-47f0-b17c-94296ff53fd7 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:19.493886 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9f20dd7c-5f12-47f0-b17c-94296ff53fd7 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:19.500868 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9f20dd7c-5f12-47f0-b17c-94296ff53fd7 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:19.501316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9f20dd7c-5f12-47f0-b17c-94296ff53fd7 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:19.502078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9f20dd7c-5f12-47f0-b17c-94296ff53fd7 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:19.502511 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9f20dd7c-5f12-47f0-b17c-94296ff53fd7 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:19.653443 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9f20dd7c-5f12-47f0-b17c-94296ff53fd7 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:19.662512 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9f20dd7c-5f12-47f0-b17c-94296ff53fd7 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.173785 Jul 25 08:46:19.663293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 30/47] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:19 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:19.670071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-28eb674a-155c-48ab-af03-1ac71fe5ca28 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:19.670689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-28eb674a-155c-48ab-af03-1ac71fe5ca28 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:19.677313 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28eb674a-155c-48ab-af03-1ac71fe5ca28 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:19.677768 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28eb674a-155c-48ab-af03-1ac71fe5ca28 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:19.678537 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28eb674a-155c-48ab-af03-1ac71fe5ca28 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:19.678970 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28eb674a-155c-48ab-af03-1ac71fe5ca28 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:19.751718 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-28eb674a-155c-48ab-af03-1ac71fe5ca28 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:19.759269 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-28eb674a-155c-48ab-af03-1ac71fe5ca28 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1245 microversion: 2.1 time: 0.092920 Jul 25 08:46:19.759844 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 18/48] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:19 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:20.084380 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c73c75be-fc68-4bc3-9585-065fac0606ff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:20.085073 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c73c75be-fc68-4bc3-9585-065fac0606ff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:20.093444 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c73c75be-fc68-4bc3-9585-065fac0606ff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:20.094182 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c73c75be-fc68-4bc3-9585-065fac0606ff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:20.095279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c73c75be-fc68-4bc3-9585-065fac0606ff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:20.095999 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c73c75be-fc68-4bc3-9585-065fac0606ff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:20.213323 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1d60332b-0563-4a62-bf1a-750d68416a39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:20.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1d60332b-0563-4a62-bf1a-750d68416a39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:20.223235 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1d60332b-0563-4a62-bf1a-750d68416a39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:20.223955 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1d60332b-0563-4a62-bf1a-750d68416a39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:20.225386 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1d60332b-0563-4a62-bf1a-750d68416a39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:20.226796 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1d60332b-0563-4a62-bf1a-750d68416a39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:20.261913 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c73c75be-fc68-4bc3-9585-065fac0606ff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:20.284396 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c73c75be-fc68-4bc3-9585-065fac0606ff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.204279 Jul 25 08:46:20.300062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 31/49] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:20 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:20.441580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1d60332b-0563-4a62-bf1a-750d68416a39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:20.450126 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1d60332b-0563-4a62-bf1a-750d68416a39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.243538 Jul 25 08:46:20.451408 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 19/50] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:20 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:20.683761 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-31ac22b8-b225-423b-8408-239c8031d625 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:20.684388 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-31ac22b8-b225-423b-8408-239c8031d625 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:20.691036 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-31ac22b8-b225-423b-8408-239c8031d625 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:20.691498 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-31ac22b8-b225-423b-8408-239c8031d625 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:20.692293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-31ac22b8-b225-423b-8408-239c8031d625 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:20.692803 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-31ac22b8-b225-423b-8408-239c8031d625 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:20.728395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-e2fb3056-b262-4da9-85ec-cb678f67139c req-62e7aad0-eb9f-4813-95b1-b91c51775c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c47421d-f63c-4f50-97c9-fe01898702c2", "tag": "f611d792-f2ac-42c7-9f33-d791e3b88419"}, {"name": "network-changed", "server_uuid": "c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7", "tag": "de1515d4-bcfe-41ca-b713-85a3e00f3b9f"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:20.741783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e2fb3056-b262-4da9-85ec-cb678f67139c req-62e7aad0-eb9f-4813-95b1-b91c51775c08 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:20.742508 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e2fb3056-b262-4da9-85ec-cb678f67139c req-62e7aad0-eb9f-4813-95b1-b91c51775c08 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:20.765869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-e2fb3056-b262-4da9-85ec-cb678f67139c req-62e7aad0-eb9f-4813-95b1-b91c51775c08 service nova] Creating event network-changed:f611d792-f2ac-42c7-9f33-d791e3b88419 for instance 1c47421d-f63c-4f50-97c9-fe01898702c2 on hv-cinder-85084 Jul 25 08:46:20.766573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-e2fb3056-b262-4da9-85ec-cb678f67139c req-62e7aad0-eb9f-4813-95b1-b91c51775c08 service nova] Creating event network-changed:de1515d4-bcfe-41ca-b713-85a3e00f3b9f for instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 on hv-cinder-85084 Jul 25 08:46:20.773073 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-e2fb3056-b262-4da9-85ec-cb678f67139c req-62e7aad0-eb9f-4813-95b1-b91c51775c08 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049323 Jul 25 08:46:20.774147 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 20/51] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:46:20.783104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-402fd2ec-3a7b-4e95-8985-81becc182084 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:20.784275 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-402fd2ec-3a7b-4e95-8985-81becc182084 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:20.790636 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-402fd2ec-3a7b-4e95-8985-81becc182084 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:20.791269 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-402fd2ec-3a7b-4e95-8985-81becc182084 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:20.792227 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-402fd2ec-3a7b-4e95-8985-81becc182084 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:20.792844 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-402fd2ec-3a7b-4e95-8985-81becc182084 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:20.845128 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-31ac22b8-b225-423b-8408-239c8031d625 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:20.853058 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-31ac22b8-b225-423b-8408-239c8031d625 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.173402 Jul 25 08:46:20.853804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 32/52] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:20 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:20.869611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-402fd2ec-3a7b-4e95-8985-81becc182084 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:20.877665 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-402fd2ec-3a7b-4e95-8985-81becc182084 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1245 microversion: 2.1 time: 0.100764 Jul 25 08:46:20.878223 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 21/53] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:20 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:21.308731 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9f086aea-4e0f-4812-9009-b0f90c4ffcf0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:21.309337 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9f086aea-4e0f-4812-9009-b0f90c4ffcf0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:21.316114 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9f086aea-4e0f-4812-9009-b0f90c4ffcf0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:21.316555 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9f086aea-4e0f-4812-9009-b0f90c4ffcf0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:21.317366 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9f086aea-4e0f-4812-9009-b0f90c4ffcf0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:21.317799 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9f086aea-4e0f-4812-9009-b0f90c4ffcf0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:21.471629 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-16c20fcd-0a0c-413b-af71-05ee0113d5e4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:21.472140 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-16c20fcd-0a0c-413b-af71-05ee0113d5e4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:21.479078 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-16c20fcd-0a0c-413b-af71-05ee0113d5e4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:21.479528 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-16c20fcd-0a0c-413b-af71-05ee0113d5e4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:21.480302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-16c20fcd-0a0c-413b-af71-05ee0113d5e4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:21.480770 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-16c20fcd-0a0c-413b-af71-05ee0113d5e4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:21.505567 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9f086aea-4e0f-4812-9009-b0f90c4ffcf0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:21.513666 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9f086aea-4e0f-4812-9009-b0f90c4ffcf0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.208729 Jul 25 08:46:21.527898 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 33/54] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:21 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:21.791168 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-16c20fcd-0a0c-413b-af71-05ee0113d5e4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:21.801898 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-16c20fcd-0a0c-413b-af71-05ee0113d5e4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.334429 Jul 25 08:46:21.802668 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 22/55] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:21 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:21.877408 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b76c0ffe-ebc0-407d-bd25-0db6f30536e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:21.878659 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b76c0ffe-ebc0-407d-bd25-0db6f30536e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:21.887364 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b76c0ffe-ebc0-407d-bd25-0db6f30536e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:21.888116 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b76c0ffe-ebc0-407d-bd25-0db6f30536e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:21.889312 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b76c0ffe-ebc0-407d-bd25-0db6f30536e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:21.890736 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b76c0ffe-ebc0-407d-bd25-0db6f30536e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:21.898862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ad82e0ea-e1d1-41c0-a536-d4c732cdffa8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:21.900019 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ad82e0ea-e1d1-41c0-a536-d4c732cdffa8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:21.913519 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad82e0ea-e1d1-41c0-a536-d4c732cdffa8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:21.915852 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad82e0ea-e1d1-41c0-a536-d4c732cdffa8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:21.920652 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad82e0ea-e1d1-41c0-a536-d4c732cdffa8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:21.921474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad82e0ea-e1d1-41c0-a536-d4c732cdffa8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:22.299674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ad82e0ea-e1d1-41c0-a536-d4c732cdffa8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:22.307564 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ad82e0ea-e1d1-41c0-a536-d4c732cdffa8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.412767 Jul 25 08:46:22.308413 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 23/56] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:21 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:22.501779 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b76c0ffe-ebc0-407d-bd25-0db6f30536e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:22.509503 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b76c0ffe-ebc0-407d-bd25-0db6f30536e5 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.638861 Jul 25 08:46:22.510143 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 34/57] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:21 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:22.535549 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-90979555-068d-4a1b-81fb-bad58967f04e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:22.536102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-90979555-068d-4a1b-81fb-bad58967f04e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:22.543076 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90979555-068d-4a1b-81fb-bad58967f04e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:22.543718 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90979555-068d-4a1b-81fb-bad58967f04e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:22.544881 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90979555-068d-4a1b-81fb-bad58967f04e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:22.545653 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90979555-068d-4a1b-81fb-bad58967f04e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:22.720322 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-90979555-068d-4a1b-81fb-bad58967f04e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:22.728057 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-90979555-068d-4a1b-81fb-bad58967f04e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.196533 Jul 25 08:46:22.728845 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 24/58] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:22 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:22.824773 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f731f804-cd28-411b-ba76-03e8838b07ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:22.825539 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f731f804-cd28-411b-ba76-03e8838b07ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:22.833423 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f731f804-cd28-411b-ba76-03e8838b07ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:22.833617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f731f804-cd28-411b-ba76-03e8838b07ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:22.835010 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f731f804-cd28-411b-ba76-03e8838b07ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:22.835588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f731f804-cd28-411b-ba76-03e8838b07ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:22.985393 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f731f804-cd28-411b-ba76-03e8838b07ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:22.994487 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f731f804-cd28-411b-ba76-03e8838b07ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.174302 Jul 25 08:46:22.995057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 35/59] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:22 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:23.329542 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e5501975-f5cb-437f-b996-ae567411f144 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:23.330153 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e5501975-f5cb-437f-b996-ae567411f144 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:23.337170 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5501975-f5cb-437f-b996-ae567411f144 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:23.337646 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5501975-f5cb-437f-b996-ae567411f144 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:23.338561 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5501975-f5cb-437f-b996-ae567411f144 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:23.339209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5501975-f5cb-437f-b996-ae567411f144 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:23.400862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e5501975-f5cb-437f-b996-ae567411f144 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:23.408801 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e5501975-f5cb-437f-b996-ae567411f144 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.083024 Jul 25 08:46:23.409369 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 25/60] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:23 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:23.531511 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-eab6cafd-6d16-4995-84e9-ddcfa935352b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:23.532121 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-eab6cafd-6d16-4995-84e9-ddcfa935352b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:23.538152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-eab6cafd-6d16-4995-84e9-ddcfa935352b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:23.538703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-eab6cafd-6d16-4995-84e9-ddcfa935352b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:23.539565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-eab6cafd-6d16-4995-84e9-ddcfa935352b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:23.540064 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-eab6cafd-6d16-4995-84e9-ddcfa935352b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:23.669313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-eab6cafd-6d16-4995-84e9-ddcfa935352b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:23.678500 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-eab6cafd-6d16-4995-84e9-ddcfa935352b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.151180 Jul 25 08:46:23.679071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 36/61] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:23 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:23.751202 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aae3d2d9-efb3-4543-8a0a-741c9414e78d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:23.752245 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-aae3d2d9-efb3-4543-8a0a-741c9414e78d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:23.761037 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aae3d2d9-efb3-4543-8a0a-741c9414e78d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:23.761494 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aae3d2d9-efb3-4543-8a0a-741c9414e78d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:23.762267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aae3d2d9-efb3-4543-8a0a-741c9414e78d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:23.762700 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aae3d2d9-efb3-4543-8a0a-741c9414e78d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:23.896626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-aae3d2d9-efb3-4543-8a0a-741c9414e78d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:23.903934 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-aae3d2d9-efb3-4543-8a0a-741c9414e78d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.158686 Jul 25 08:46:23.904508 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 26/62] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:23 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:24.015658 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dc810cae-2d04-4ccb-932d-34185331d58c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:24.016320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dc810cae-2d04-4ccb-932d-34185331d58c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:24.023150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc810cae-2d04-4ccb-932d-34185331d58c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:24.023618 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc810cae-2d04-4ccb-932d-34185331d58c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:24.024376 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc810cae-2d04-4ccb-932d-34185331d58c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:24.024832 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc810cae-2d04-4ccb-932d-34185331d58c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:24.157821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dc810cae-2d04-4ccb-932d-34185331d58c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:24.165367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dc810cae-2d04-4ccb-932d-34185331d58c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.153775 Jul 25 08:46:24.166082 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 37/63] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:24 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:24.430234 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-664f62ea-f487-44b9-8d47-ef79dd37bdc6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:24.430852 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-664f62ea-f487-44b9-8d47-ef79dd37bdc6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:24.436839 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-664f62ea-f487-44b9-8d47-ef79dd37bdc6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:24.437578 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-664f62ea-f487-44b9-8d47-ef79dd37bdc6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:24.438332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-664f62ea-f487-44b9-8d47-ef79dd37bdc6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:24.438767 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-664f62ea-f487-44b9-8d47-ef79dd37bdc6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:24.505432 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-664f62ea-f487-44b9-8d47-ef79dd37bdc6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:24.516563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-664f62ea-f487-44b9-8d47-ef79dd37bdc6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.089478 Jul 25 08:46:24.516563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 27/64] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:24 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:24.699387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-69b8819c-9376-49c3-813b-e7d4a64023e3 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:24.700003 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-69b8819c-9376-49c3-813b-e7d4a64023e3 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:24.706074 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69b8819c-9376-49c3-813b-e7d4a64023e3 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:24.706519 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69b8819c-9376-49c3-813b-e7d4a64023e3 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:24.707271 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69b8819c-9376-49c3-813b-e7d4a64023e3 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:24.707705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69b8819c-9376-49c3-813b-e7d4a64023e3 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:24.845687 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-69b8819c-9376-49c3-813b-e7d4a64023e3 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:24.853131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-69b8819c-9376-49c3-813b-e7d4a64023e3 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.157564 Jul 25 08:46:24.853947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 38/65] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:24 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:24.924807 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e1333903-983b-452b-81e6-98111f1075f2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:24.925426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e1333903-983b-452b-81e6-98111f1075f2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:24.931264 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e1333903-983b-452b-81e6-98111f1075f2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:24.931718 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e1333903-983b-452b-81e6-98111f1075f2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:24.932480 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e1333903-983b-452b-81e6-98111f1075f2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:24.932940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e1333903-983b-452b-81e6-98111f1075f2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:25.070196 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e1333903-983b-452b-81e6-98111f1075f2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:25.079826 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e1333903-983b-452b-81e6-98111f1075f2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.159399 Jul 25 08:46:25.080400 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 28/66] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:24 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:25.186369 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-747807da-c72a-44e9-bc79-1e418bc2c9d3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:25.187493 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-747807da-c72a-44e9-bc79-1e418bc2c9d3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:25.193707 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-747807da-c72a-44e9-bc79-1e418bc2c9d3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:25.194016 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-747807da-c72a-44e9-bc79-1e418bc2c9d3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:25.194780 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-747807da-c72a-44e9-bc79-1e418bc2c9d3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:25.195220 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-747807da-c72a-44e9-bc79-1e418bc2c9d3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:25.346801 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-747807da-c72a-44e9-bc79-1e418bc2c9d3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:25.354225 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-747807da-c72a-44e9-bc79-1e418bc2c9d3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.171738 Jul 25 08:46:25.354799 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 39/67] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:25 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:25.537344 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9f2bfdd7-4958-4868-8390-cb522f7a004f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:25.538141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9f2bfdd7-4958-4868-8390-cb522f7a004f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:25.545613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f2bfdd7-4958-4868-8390-cb522f7a004f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:25.546706 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f2bfdd7-4958-4868-8390-cb522f7a004f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:25.547466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f2bfdd7-4958-4868-8390-cb522f7a004f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:25.547896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f2bfdd7-4958-4868-8390-cb522f7a004f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:25.622700 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9f2bfdd7-4958-4868-8390-cb522f7a004f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:25.630270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9f2bfdd7-4958-4868-8390-cb522f7a004f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.096841 Jul 25 08:46:25.630899 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 29/68] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:25 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:25.877290 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fcec5d97-f56f-46f5-a0f0-0e9d61afe693 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:25.878377 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fcec5d97-f56f-46f5-a0f0-0e9d61afe693 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:25.894098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fcec5d97-f56f-46f5-a0f0-0e9d61afe693 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:25.894618 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fcec5d97-f56f-46f5-a0f0-0e9d61afe693 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:25.895560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fcec5d97-f56f-46f5-a0f0-0e9d61afe693 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:25.896028 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fcec5d97-f56f-46f5-a0f0-0e9d61afe693 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:26.032316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fcec5d97-f56f-46f5-a0f0-0e9d61afe693 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:26.040399 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fcec5d97-f56f-46f5-a0f0-0e9d61afe693 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.169033 Jul 25 08:46:26.040990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 40/69] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:25 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:26.101501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1a5499cf-7caf-4dc1-9e98-ff04f644286c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:26.102979 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1a5499cf-7caf-4dc1-9e98-ff04f644286c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:26.109546 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1a5499cf-7caf-4dc1-9e98-ff04f644286c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:26.110260 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1a5499cf-7caf-4dc1-9e98-ff04f644286c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:26.111031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1a5499cf-7caf-4dc1-9e98-ff04f644286c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:26.111474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1a5499cf-7caf-4dc1-9e98-ff04f644286c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:26.240065 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1a5499cf-7caf-4dc1-9e98-ff04f644286c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:26.247832 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1a5499cf-7caf-4dc1-9e98-ff04f644286c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.150550 Jul 25 08:46:26.248407 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 30/70] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:26 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:26.374214 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f7b1e7c6-5697-4e1b-81a7-4fa59cc81bd8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:26.374919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f7b1e7c6-5697-4e1b-81a7-4fa59cc81bd8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:26.381923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f7b1e7c6-5697-4e1b-81a7-4fa59cc81bd8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:26.382376 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f7b1e7c6-5697-4e1b-81a7-4fa59cc81bd8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:26.383156 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f7b1e7c6-5697-4e1b-81a7-4fa59cc81bd8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:26.383759 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f7b1e7c6-5697-4e1b-81a7-4fa59cc81bd8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:26.521207 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f7b1e7c6-5697-4e1b-81a7-4fa59cc81bd8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:26.528932 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f7b1e7c6-5697-4e1b-81a7-4fa59cc81bd8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.158581 Jul 25 08:46:26.529584 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 41/71] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:26 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:26.651036 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4cbbf931-a29b-4149-8e76-e2e892197fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:26.652139 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4cbbf931-a29b-4149-8e76-e2e892197fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:26.658709 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4cbbf931-a29b-4149-8e76-e2e892197fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:26.659164 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4cbbf931-a29b-4149-8e76-e2e892197fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:26.659928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4cbbf931-a29b-4149-8e76-e2e892197fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:26.660359 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4cbbf931-a29b-4149-8e76-e2e892197fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:26.726701 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4cbbf931-a29b-4149-8e76-e2e892197fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:26.737424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4cbbf931-a29b-4149-8e76-e2e892197fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.090127 Jul 25 08:46:26.738003 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 31/72] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:26 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:27.060069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-17a18923-aea7-4b24-b45b-10336f238880 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:27.060706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-17a18923-aea7-4b24-b45b-10336f238880 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:27.066670 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-17a18923-aea7-4b24-b45b-10336f238880 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:27.067111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-17a18923-aea7-4b24-b45b-10336f238880 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:27.067864 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-17a18923-aea7-4b24-b45b-10336f238880 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:27.068289 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-17a18923-aea7-4b24-b45b-10336f238880 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:27.199282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-17a18923-aea7-4b24-b45b-10336f238880 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:27.207479 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-17a18923-aea7-4b24-b45b-10336f238880 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.151162 Jul 25 08:46:27.208038 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 42/73] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:27 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:27.268721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c362334c-89b2-47d5-b1e4-4a40ee6961c0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:27.269340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c362334c-89b2-47d5-b1e4-4a40ee6961c0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:27.275283 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c362334c-89b2-47d5-b1e4-4a40ee6961c0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:27.275737 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c362334c-89b2-47d5-b1e4-4a40ee6961c0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:27.276497 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c362334c-89b2-47d5-b1e4-4a40ee6961c0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:27.276963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c362334c-89b2-47d5-b1e4-4a40ee6961c0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:27.419159 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c362334c-89b2-47d5-b1e4-4a40ee6961c0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:27.426880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c362334c-89b2-47d5-b1e4-4a40ee6961c0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.162005 Jul 25 08:46:27.427445 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 32/74] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:27 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:27.551366 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f1782c12-7ed2-4395-983c-e94362b3957c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:27.552764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f1782c12-7ed2-4395-983c-e94362b3957c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:27.554898 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:27.560694 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1782c12-7ed2-4395-983c-e94362b3957c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:27.561333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1782c12-7ed2-4395-983c-e94362b3957c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:27.562787 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1782c12-7ed2-4395-983c-e94362b3957c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:27.563366 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1782c12-7ed2-4395-983c-e94362b3957c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:27.695161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f1782c12-7ed2-4395-983c-e94362b3957c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:27.703052 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f1782c12-7ed2-4395-983c-e94362b3957c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.157115 Jul 25 08:46:27.703680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 43/75] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:27 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:27.760711 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-61e6e4bb-8d14-439f-9231-be5b62ee6af4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:27.761583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-61e6e4bb-8d14-439f-9231-be5b62ee6af4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:27.768928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61e6e4bb-8d14-439f-9231-be5b62ee6af4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:27.769377 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61e6e4bb-8d14-439f-9231-be5b62ee6af4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:27.770138 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61e6e4bb-8d14-439f-9231-be5b62ee6af4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:27.770568 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61e6e4bb-8d14-439f-9231-be5b62ee6af4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:27.785772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:27.833151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-61e6e4bb-8d14-439f-9231-be5b62ee6af4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:27.838597 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:27.841269 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-61e6e4bb-8d14-439f-9231-be5b62ee6af4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.085630 Jul 25 08:46:27.841841 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 33/76] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:27 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:28.230149 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-cf6e82c2-30b8-46f0-a43c-22cc7d3523dd tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:28.230966 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-cf6e82c2-30b8-46f0-a43c-22cc7d3523dd tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:28.237871 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf6e82c2-30b8-46f0-a43c-22cc7d3523dd tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:28.238418 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf6e82c2-30b8-46f0-a43c-22cc7d3523dd tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:28.239337 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf6e82c2-30b8-46f0-a43c-22cc7d3523dd tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:28.239947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf6e82c2-30b8-46f0-a43c-22cc7d3523dd tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:28.377730 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-cf6e82c2-30b8-46f0-a43c-22cc7d3523dd tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:28.385190 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-cf6e82c2-30b8-46f0-a43c-22cc7d3523dd tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.160975 Jul 25 08:46:28.386379 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 44/77] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:28 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:28.447368 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a9995c30-5291-45a8-ade7-3095ef6038f9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:28.447966 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a9995c30-5291-45a8-ade7-3095ef6038f9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:28.454987 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9995c30-5291-45a8-ade7-3095ef6038f9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:28.455528 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9995c30-5291-45a8-ade7-3095ef6038f9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:28.456173 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9995c30-5291-45a8-ade7-3095ef6038f9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:28.456659 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9995c30-5291-45a8-ade7-3095ef6038f9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:28.585474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a9995c30-5291-45a8-ade7-3095ef6038f9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:28.592808 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a9995c30-5291-45a8-ade7-3095ef6038f9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.149214 Jul 25 08:46:28.593504 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 34/78] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:28 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:28.723503 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2380acb1-24aa-4850-9907-774c2fea0f90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:28.725150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2380acb1-24aa-4850-9907-774c2fea0f90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:28.729927 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:28.732634 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2380acb1-24aa-4850-9907-774c2fea0f90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:28.733112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2380acb1-24aa-4850-9907-774c2fea0f90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:28.733878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2380acb1-24aa-4850-9907-774c2fea0f90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:28.734307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2380acb1-24aa-4850-9907-774c2fea0f90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:28.862534 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e6042b77-2371-4460-839c-a01493ed284d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:28.863178 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e6042b77-2371-4460-839c-a01493ed284d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:28.865038 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:28.870658 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e6042b77-2371-4460-839c-a01493ed284d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:28.871111 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e6042b77-2371-4460-839c-a01493ed284d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:28.871833 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2380acb1-24aa-4850-9907-774c2fea0f90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:28.871959 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e6042b77-2371-4460-839c-a01493ed284d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:28.872308 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e6042b77-2371-4460-839c-a01493ed284d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:28.879829 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2380acb1-24aa-4850-9907-774c2fea0f90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.160442 Jul 25 08:46:28.880422 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 45/79] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:28 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:28.932896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e6042b77-2371-4460-839c-a01493ed284d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:28.940849 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e6042b77-2371-4460-839c-a01493ed284d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.082613 Jul 25 08:46:28.941411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 35/80] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:28 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:29.407647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e8a8fcf8-32f0-4f83-862d-3f982aacbc76 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:29.408259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e8a8fcf8-32f0-4f83-862d-3f982aacbc76 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:29.414201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e8a8fcf8-32f0-4f83-862d-3f982aacbc76 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:29.414642 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e8a8fcf8-32f0-4f83-862d-3f982aacbc76 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:29.415387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e8a8fcf8-32f0-4f83-862d-3f982aacbc76 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:29.415812 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e8a8fcf8-32f0-4f83-862d-3f982aacbc76 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:29.419783 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=100 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:29.542087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e8a8fcf8-32f0-4f83-862d-3f982aacbc76 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:29.549969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e8a8fcf8-32f0-4f83-862d-3f982aacbc76 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.146605 Jul 25 08:46:29.550526 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 46/81] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:29 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:29.613308 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8619adca-bb6a-4353-b708-f93caa466058 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:29.613851 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8619adca-bb6a-4353-b708-f93caa466058 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:29.620018 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8619adca-bb6a-4353-b708-f93caa466058 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:29.620463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8619adca-bb6a-4353-b708-f93caa466058 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:29.621253 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8619adca-bb6a-4353-b708-f93caa466058 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:29.621685 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8619adca-bb6a-4353-b708-f93caa466058 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:29.757060 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8619adca-bb6a-4353-b708-f93caa466058 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:29.765814 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8619adca-bb6a-4353-b708-f93caa466058 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.156190 Jul 25 08:46:29.766403 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 36/82] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:29 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:29.900375 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-62075813-c9f1-46c9-a325-d8ec78de0dfe tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:29.901060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-62075813-c9f1-46c9-a325-d8ec78de0dfe tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:29.907668 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-62075813-c9f1-46c9-a325-d8ec78de0dfe tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:29.908110 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-62075813-c9f1-46c9-a325-d8ec78de0dfe tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:29.908888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-62075813-c9f1-46c9-a325-d8ec78de0dfe tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:29.909320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-62075813-c9f1-46c9-a325-d8ec78de0dfe tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:29.961011 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-93a812d3-350f-46b1-bc19-629032bfed97 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:29.961664 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-93a812d3-350f-46b1-bc19-629032bfed97 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:29.967831 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a812d3-350f-46b1-bc19-629032bfed97 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:29.968384 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a812d3-350f-46b1-bc19-629032bfed97 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:29.969187 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a812d3-350f-46b1-bc19-629032bfed97 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:29.969617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a812d3-350f-46b1-bc19-629032bfed97 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:30.044563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-93a812d3-350f-46b1-bc19-629032bfed97 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:30.053740 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-93a812d3-350f-46b1-bc19-629032bfed97 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.096470 Jul 25 08:46:30.055992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 37/83] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:29 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:30.063887 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-62075813-c9f1-46c9-a325-d8ec78de0dfe tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:30.072116 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-62075813-c9f1-46c9-a325-d8ec78de0dfe tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.175415 Jul 25 08:46:30.072706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 47/84] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:29 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:30.570069 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c67a3ced-8a0d-477b-af9a-7cf1f4f35810 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:30.570600 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c67a3ced-8a0d-477b-af9a-7cf1f4f35810 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:30.576626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c67a3ced-8a0d-477b-af9a-7cf1f4f35810 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:30.577571 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c67a3ced-8a0d-477b-af9a-7cf1f4f35810 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:30.578330 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c67a3ced-8a0d-477b-af9a-7cf1f4f35810 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:30.578765 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c67a3ced-8a0d-477b-af9a-7cf1f4f35810 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:30.707792 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c67a3ced-8a0d-477b-af9a-7cf1f4f35810 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:30.715108 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c67a3ced-8a0d-477b-af9a-7cf1f4f35810 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.148980 Jul 25 08:46:30.715669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 38/85] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:30 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:30.785942 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-463d37ca-c2e2-4642-93c0-17bebe1e6e7f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:30.786552 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-463d37ca-c2e2-4642-93c0-17bebe1e6e7f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:30.792516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-463d37ca-c2e2-4642-93c0-17bebe1e6e7f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:30.792996 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-463d37ca-c2e2-4642-93c0-17bebe1e6e7f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:30.793751 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-463d37ca-c2e2-4642-93c0-17bebe1e6e7f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:30.794189 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-463d37ca-c2e2-4642-93c0-17bebe1e6e7f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:30.933083 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-463d37ca-c2e2-4642-93c0-17bebe1e6e7f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:30.944763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-463d37ca-c2e2-4642-93c0-17bebe1e6e7f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.160651 Jul 25 08:46:30.944763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 48/86] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:30 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:31.074383 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7273907c-fe00-4208-97c7-821701ba1458 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:31.074999 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7273907c-fe00-4208-97c7-821701ba1458 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:31.081125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7273907c-fe00-4208-97c7-821701ba1458 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:31.081578 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7273907c-fe00-4208-97c7-821701ba1458 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:31.082344 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7273907c-fe00-4208-97c7-821701ba1458 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:31.082780 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7273907c-fe00-4208-97c7-821701ba1458 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:31.093383 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4a733632-0573-4ae9-828a-23008c43f2f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:31.097440 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4a733632-0573-4ae9-828a-23008c43f2f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:31.101266 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4a733632-0573-4ae9-828a-23008c43f2f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:31.101783 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4a733632-0573-4ae9-828a-23008c43f2f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:31.102644 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4a733632-0573-4ae9-828a-23008c43f2f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:31.103149 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4a733632-0573-4ae9-828a-23008c43f2f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:31.146705 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7273907c-fe00-4208-97c7-821701ba1458 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:31.154079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7273907c-fe00-4208-97c7-821701ba1458 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.083574 Jul 25 08:46:31.154651 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 39/87] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:31 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:31.241314 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4a733632-0573-4ae9-828a-23008c43f2f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:31.249256 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4a733632-0573-4ae9-828a-23008c43f2f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.159370 Jul 25 08:46:31.249830 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 49/88] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:31 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:31.736762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f6ac3c39-e9db-48de-8efa-7946eba777ef tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:31.737376 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f6ac3c39-e9db-48de-8efa-7946eba777ef tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:31.743379 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6ac3c39-e9db-48de-8efa-7946eba777ef tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:31.744233 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6ac3c39-e9db-48de-8efa-7946eba777ef tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:31.745060 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6ac3c39-e9db-48de-8efa-7946eba777ef tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:31.745506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6ac3c39-e9db-48de-8efa-7946eba777ef tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:31.870122 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f6ac3c39-e9db-48de-8efa-7946eba777ef tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:31.877443 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f6ac3c39-e9db-48de-8efa-7946eba777ef tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.145508 Jul 25 08:46:31.878008 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 40/89] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:31 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:31.964813 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f93624b8-423a-4c0b-8d2c-c7e03dd24f3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:31.965428 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f93624b8-423a-4c0b-8d2c-c7e03dd24f3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:31.971661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f93624b8-423a-4c0b-8d2c-c7e03dd24f3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:31.972100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f93624b8-423a-4c0b-8d2c-c7e03dd24f3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:31.973150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f93624b8-423a-4c0b-8d2c-c7e03dd24f3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:31.973713 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f93624b8-423a-4c0b-8d2c-c7e03dd24f3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:32.106662 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f93624b8-423a-4c0b-8d2c-c7e03dd24f3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:32.114663 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f93624b8-423a-4c0b-8d2c-c7e03dd24f3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.153707 Jul 25 08:46:32.115228 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 50/90] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:31 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:32.174280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f67f22ab-c88f-46f4-9a3d-45d4e36fccac tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:32.174892 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f67f22ab-c88f-46f4-9a3d-45d4e36fccac tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:32.180907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f67f22ab-c88f-46f4-9a3d-45d4e36fccac tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:32.181359 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f67f22ab-c88f-46f4-9a3d-45d4e36fccac tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:32.182116 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f67f22ab-c88f-46f4-9a3d-45d4e36fccac tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:32.182549 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f67f22ab-c88f-46f4-9a3d-45d4e36fccac tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:32.242209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f67f22ab-c88f-46f4-9a3d-45d4e36fccac tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:32.249509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f67f22ab-c88f-46f4-9a3d-45d4e36fccac tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.079571 Jul 25 08:46:32.250073 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 41/91] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:32 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:32.271307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-58bf8c09-e73a-4fe3-90b6-a82fb9e46ce4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:32.271941 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-58bf8c09-e73a-4fe3-90b6-a82fb9e46ce4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:32.278021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-58bf8c09-e73a-4fe3-90b6-a82fb9e46ce4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:32.278473 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-58bf8c09-e73a-4fe3-90b6-a82fb9e46ce4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:32.279241 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-58bf8c09-e73a-4fe3-90b6-a82fb9e46ce4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:32.279678 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-58bf8c09-e73a-4fe3-90b6-a82fb9e46ce4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:32.412910 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-58bf8c09-e73a-4fe3-90b6-a82fb9e46ce4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:32.422298 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-58bf8c09-e73a-4fe3-90b6-a82fb9e46ce4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.154663 Jul 25 08:46:32.422907 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 51/92] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:32 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:32.898874 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d4caae83-7267-40e2-854a-e645cca65897 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:32.899500 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d4caae83-7267-40e2-854a-e645cca65897 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:32.905533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4caae83-7267-40e2-854a-e645cca65897 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:32.905977 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4caae83-7267-40e2-854a-e645cca65897 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:32.906734 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4caae83-7267-40e2-854a-e645cca65897 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:32.907168 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4caae83-7267-40e2-854a-e645cca65897 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:33.044071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d4caae83-7267-40e2-854a-e645cca65897 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:33.065729 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d4caae83-7267-40e2-854a-e645cca65897 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.170572 Jul 25 08:46:33.066401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 42/93] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:32 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:33.136334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e82088d0-1f61-42f3-8efc-cd4995bdbfa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:33.137048 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e82088d0-1f61-42f3-8efc-cd4995bdbfa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:33.142993 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e82088d0-1f61-42f3-8efc-cd4995bdbfa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:33.143436 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e82088d0-1f61-42f3-8efc-cd4995bdbfa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:33.144191 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e82088d0-1f61-42f3-8efc-cd4995bdbfa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:33.144640 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e82088d0-1f61-42f3-8efc-cd4995bdbfa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:33.273615 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e82088d0-1f61-42f3-8efc-cd4995bdbfa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:33.282029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e82088d0-1f61-42f3-8efc-cd4995bdbfa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.149534 Jul 25 08:46:33.282757 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7eaa0e26-1640-489e-a2d0-58d060221d82 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:33.283379 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7eaa0e26-1640-489e-a2d0-58d060221d82 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:33.289521 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7eaa0e26-1640-489e-a2d0-58d060221d82 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:33.290184 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7eaa0e26-1640-489e-a2d0-58d060221d82 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:33.290970 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7eaa0e26-1640-489e-a2d0-58d060221d82 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:33.291411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7eaa0e26-1640-489e-a2d0-58d060221d82 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:33.295050 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 52/94] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:33 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:33.356162 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7eaa0e26-1640-489e-a2d0-58d060221d82 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:33.364341 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7eaa0e26-1640-489e-a2d0-58d060221d82 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1293 microversion: 2.1 time: 0.085866 Jul 25 08:46:33.364945 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 43/95] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:33 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:33.443567 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8ab08814-c483-4e40-9bcd-bc018fa60856 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:33.444185 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-8ab08814-c483-4e40-9bcd-bc018fa60856 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:33.450753 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8ab08814-c483-4e40-9bcd-bc018fa60856 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:33.451179 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8ab08814-c483-4e40-9bcd-bc018fa60856 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:33.452214 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8ab08814-c483-4e40-9bcd-bc018fa60856 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:33.452675 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8ab08814-c483-4e40-9bcd-bc018fa60856 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:33.584816 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8ab08814-c483-4e40-9bcd-bc018fa60856 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:33.592139 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8ab08814-c483-4e40-9bcd-bc018fa60856 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.152674 Jul 25 08:46:33.593334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 53/96] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:33 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:34.086920 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2ec8c049-9263-4a3c-be43-c6830d89a5ba tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:34.087642 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2ec8c049-9263-4a3c-be43-c6830d89a5ba tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:34.098217 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ec8c049-9263-4a3c-be43-c6830d89a5ba tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:34.100241 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ec8c049-9263-4a3c-be43-c6830d89a5ba tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:34.101888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ec8c049-9263-4a3c-be43-c6830d89a5ba tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:34.102930 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ec8c049-9263-4a3c-be43-c6830d89a5ba tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:34.304766 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bf8b9115-15a5-4c4e-b7d1-921e02d556d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:34.305688 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bf8b9115-15a5-4c4e-b7d1-921e02d556d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:34.321611 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf8b9115-15a5-4c4e-b7d1-921e02d556d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:34.322217 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf8b9115-15a5-4c4e-b7d1-921e02d556d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:34.325107 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf8b9115-15a5-4c4e-b7d1-921e02d556d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:34.325726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf8b9115-15a5-4c4e-b7d1-921e02d556d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:34.642534 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2ec8c049-9263-4a3c-be43-c6830d89a5ba tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:34.659735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2ec8c049-9263-4a3c-be43-c6830d89a5ba tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.576964 Jul 25 08:46:34.660662 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 44/97] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:34 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:34.666197 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7f13bbd3-b02b-4452-9df5-3a6108b271be tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:34.667121 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7f13bbd3-b02b-4452-9df5-3a6108b271be tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:34.674553 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f13bbd3-b02b-4452-9df5-3a6108b271be tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:34.675192 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f13bbd3-b02b-4452-9df5-3a6108b271be tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:34.676337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f13bbd3-b02b-4452-9df5-3a6108b271be tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:34.676868 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f13bbd3-b02b-4452-9df5-3a6108b271be tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:34.711808 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bf8b9115-15a5-4c4e-b7d1-921e02d556d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:34.721084 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bf8b9115-15a5-4c4e-b7d1-921e02d556d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.421161 Jul 25 08:46:34.722387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 54/98] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:34 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:34.727162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-69af3362-b753-4225-991a-68176bb44b00 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:34.727776 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-69af3362-b753-4225-991a-68176bb44b00 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:34.738407 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69af3362-b753-4225-991a-68176bb44b00 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:34.739411 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69af3362-b753-4225-991a-68176bb44b00 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:34.740351 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69af3362-b753-4225-991a-68176bb44b00 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:34.741115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69af3362-b753-4225-991a-68176bb44b00 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:34.763505 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7f13bbd3-b02b-4452-9df5-3a6108b271be tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:34.776523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7f13bbd3-b02b-4452-9df5-3a6108b271be tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1299 microversion: 2.1 time: 0.114413 Jul 25 08:46:34.777946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 45/99] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:34 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:34.920066 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-69af3362-b753-4225-991a-68176bb44b00 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:34.928072 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-69af3362-b753-4225-991a-68176bb44b00 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.204445 Jul 25 08:46:34.928677 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 55/100] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:34 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:35.695199 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5c6bfcf6-4cfe-4e6b-93e0-cc543b6cc249 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:35.695910 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5c6bfcf6-4cfe-4e6b-93e0-cc543b6cc249 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:35.705502 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c6bfcf6-4cfe-4e6b-93e0-cc543b6cc249 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:35.706143 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c6bfcf6-4cfe-4e6b-93e0-cc543b6cc249 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:35.707530 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c6bfcf6-4cfe-4e6b-93e0-cc543b6cc249 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:35.708422 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c6bfcf6-4cfe-4e6b-93e0-cc543b6cc249 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:35.744018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8e1ef614-de5d-4caf-8ed7-986f076ba23d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:35.744692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-8e1ef614-de5d-4caf-8ed7-986f076ba23d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:35.751356 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8e1ef614-de5d-4caf-8ed7-986f076ba23d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:35.753316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8e1ef614-de5d-4caf-8ed7-986f076ba23d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:35.754261 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8e1ef614-de5d-4caf-8ed7-986f076ba23d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:35.756769 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8e1ef614-de5d-4caf-8ed7-986f076ba23d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:35.950188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5c6bfcf6-4cfe-4e6b-93e0-cc543b6cc249 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:35.960151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5c6bfcf6-4cfe-4e6b-93e0-cc543b6cc249 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.270955 Jul 25 08:46:35.973548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 46/101] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:35 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:35.983515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8e1ef614-de5d-4caf-8ed7-986f076ba23d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:35.985335 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fe3fe941-e79e-4530-b878-3198e3c4339c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:35.985951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fe3fe941-e79e-4530-b878-3198e3c4339c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:35.993359 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fe3fe941-e79e-4530-b878-3198e3c4339c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:35.993533 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8e1ef614-de5d-4caf-8ed7-986f076ba23d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.253249 Jul 25 08:46:35.994255 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fe3fe941-e79e-4530-b878-3198e3c4339c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:35.994525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 56/102] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:35 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:35.995395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fe3fe941-e79e-4530-b878-3198e3c4339c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:35.995972 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fe3fe941-e79e-4530-b878-3198e3c4339c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:36.017050 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2562da29-b98e-4cd8-9d1d-3470be08d9ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:36.017764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2562da29-b98e-4cd8-9d1d-3470be08d9ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:36.040942 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2562da29-b98e-4cd8-9d1d-3470be08d9ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:36.041813 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2562da29-b98e-4cd8-9d1d-3470be08d9ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:36.042872 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2562da29-b98e-4cd8-9d1d-3470be08d9ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:36.043445 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2562da29-b98e-4cd8-9d1d-3470be08d9ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:36.095918 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fe3fe941-e79e-4530-b878-3198e3c4339c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:36.112253 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fe3fe941-e79e-4530-b878-3198e3c4339c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1299 microversion: 2.1 time: 0.132012 Jul 25 08:46:36.113021 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 47/103] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:35 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:36.267948 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2562da29-b98e-4cd8-9d1d-3470be08d9ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:36.276463 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2562da29-b98e-4cd8-9d1d-3470be08d9ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.267060 Jul 25 08:46:36.277079 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 57/104] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:35 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:36.988693 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ac5cf738-661d-46a8-a57f-b4380aa45598 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:36.989502 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ac5cf738-661d-46a8-a57f-b4380aa45598 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:37.000243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac5cf738-661d-46a8-a57f-b4380aa45598 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:37.000733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac5cf738-661d-46a8-a57f-b4380aa45598 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:37.001565 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac5cf738-661d-46a8-a57f-b4380aa45598 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:37.002054 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac5cf738-661d-46a8-a57f-b4380aa45598 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:37.022153 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b3407cc0-d62d-4d80-b145-203c1ef58b21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:37.024041 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b3407cc0-d62d-4d80-b145-203c1ef58b21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:37.041604 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b3407cc0-d62d-4d80-b145-203c1ef58b21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:37.052027 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b3407cc0-d62d-4d80-b145-203c1ef58b21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:37.058687 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b3407cc0-d62d-4d80-b145-203c1ef58b21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:37.059401 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b3407cc0-d62d-4d80-b145-203c1ef58b21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:37.335812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ac5cf738-661d-46a8-a57f-b4380aa45598 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:37.343714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b3407cc0-d62d-4d80-b145-203c1ef58b21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:37.358307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b3407cc0-d62d-4d80-b145-203c1ef58b21 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.340989 Jul 25 08:46:37.359308 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ac5cf738-661d-46a8-a57f-b4380aa45598 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.374637 Jul 25 08:46:37.359988 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 48/105] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:36 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:37.360927 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 58/106] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:37 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:37.370180 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-defd5ed2-cbbe-432e-b291-6944a4e48bce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:37.370796 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-defd5ed2-cbbe-432e-b291-6944a4e48bce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:37.378994 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-defd5ed2-cbbe-432e-b291-6944a4e48bce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:37.379786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-defd5ed2-cbbe-432e-b291-6944a4e48bce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:37.380715 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-defd5ed2-cbbe-432e-b291-6944a4e48bce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:37.381291 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-defd5ed2-cbbe-432e-b291-6944a4e48bce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:37.461469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-defd5ed2-cbbe-432e-b291-6944a4e48bce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:37.471932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-defd5ed2-cbbe-432e-b291-6944a4e48bce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1299 microversion: 2.1 time: 0.107652 Jul 25 08:46:37.472850 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 49/107] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:37 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:37.504267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d150168c-0464-4b7a-a4de-95ccd534fc93 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:37.506051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d150168c-0464-4b7a-a4de-95ccd534fc93 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:37.515780 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d150168c-0464-4b7a-a4de-95ccd534fc93 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:37.516414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d150168c-0464-4b7a-a4de-95ccd534fc93 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:37.517469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d150168c-0464-4b7a-a4de-95ccd534fc93 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:37.519131 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d150168c-0464-4b7a-a4de-95ccd534fc93 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:37.546932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:37.707333 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d150168c-0464-4b7a-a4de-95ccd534fc93 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:37.716785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d150168c-0464-4b7a-a4de-95ccd534fc93 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.237886 Jul 25 08:46:37.718059 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 50/108] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:37 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:37.801957 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-a333f305-e9bb-447c-b250-436460a0c3f7 req-a4360785-d8c4-467f-9d59-3a4578b19e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a72735-dc04-46c8-93bb-0ac441aed151", "name": "network-vif-plugged", "status": "completed", "tag": "28a4c653-6358-4c44-a455-40a51fe64fbc"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:37.814766 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-a333f305-e9bb-447c-b250-436460a0c3f7 req-a4360785-d8c4-467f-9d59-3a4578b19e34 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:37.815278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-a333f305-e9bb-447c-b250-436460a0c3f7 req-a4360785-d8c4-467f-9d59-3a4578b19e34 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:37.832114 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-a333f305-e9bb-447c-b250-436460a0c3f7 req-a4360785-d8c4-467f-9d59-3a4578b19e34 service nova] Creating event network-vif-plugged:28a4c653-6358-4c44-a455-40a51fe64fbc for instance 71a72735-dc04-46c8-93bb-0ac441aed151 on hv-cinder-85084 Jul 25 08:46:37.839262 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-a333f305-e9bb-447c-b250-436460a0c3f7 req-a4360785-d8c4-467f-9d59-3a4578b19e34 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.476104 Jul 25 08:46:37.840372 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 59/109] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:38.380469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0f1a3c95-cf26-49c8-81c1-308a381e723b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:38.380997 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c1d9d87b-187c-46c7-87b5-6ba6173b49c0 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:38.381341 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0f1a3c95-cf26-49c8-81c1-308a381e723b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:38.381523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c1d9d87b-187c-46c7-87b5-6ba6173b49c0 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:38.390261 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f1a3c95-cf26-49c8-81c1-308a381e723b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:38.390987 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f1a3c95-cf26-49c8-81c1-308a381e723b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:38.391067 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c1d9d87b-187c-46c7-87b5-6ba6173b49c0 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:38.391996 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f1a3c95-cf26-49c8-81c1-308a381e723b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:38.392506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f1a3c95-cf26-49c8-81c1-308a381e723b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:38.393036 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c1d9d87b-187c-46c7-87b5-6ba6173b49c0 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:38.393840 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c1d9d87b-187c-46c7-87b5-6ba6173b49c0 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:38.394274 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c1d9d87b-187c-46c7-87b5-6ba6173b49c0 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:38.686211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0f1a3c95-cf26-49c8-81c1-308a381e723b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:38.689590 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c1d9d87b-187c-46c7-87b5-6ba6173b49c0 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:38.694823 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0f1a3c95-cf26-49c8-81c1-308a381e723b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.319140 Jul 25 08:46:38.698148 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 51/110] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:38 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:38.705215 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-742d007c-a38c-4e32-bc08-4197af12173b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:38.705434 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-742d007c-a38c-4e32-bc08-4197af12173b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:38.711631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-742d007c-a38c-4e32-bc08-4197af12173b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:38.712359 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-742d007c-a38c-4e32-bc08-4197af12173b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:38.717973 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-742d007c-a38c-4e32-bc08-4197af12173b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:38.718689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-742d007c-a38c-4e32-bc08-4197af12173b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:38.723159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c1d9d87b-187c-46c7-87b5-6ba6173b49c0 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.346353 Jul 25 08:46:38.726123 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 60/111] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:38 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:38.747317 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d9e4b469-5b77-4342-ac58-6e8d754959b5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:38.754941 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d9e4b469-5b77-4342-ac58-6e8d754959b5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:38.771577 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d9e4b469-5b77-4342-ac58-6e8d754959b5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:38.774135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d9e4b469-5b77-4342-ac58-6e8d754959b5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:38.775235 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d9e4b469-5b77-4342-ac58-6e8d754959b5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:38.775842 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d9e4b469-5b77-4342-ac58-6e8d754959b5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:38.872537 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-742d007c-a38c-4e32-bc08-4197af12173b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:38.883410 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-742d007c-a38c-4e32-bc08-4197af12173b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1299 microversion: 2.1 time: 0.184140 Jul 25 08:46:38.883985 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 52/112] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:38 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1299 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:39.425449 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d9e4b469-5b77-4342-ac58-6e8d754959b5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:39.440353 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d9e4b469-5b77-4342-ac58-6e8d754959b5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.699415 Jul 25 08:46:39.442269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 61/113] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:38 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:39.721345 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-965b2d2c-3118-4f86-a3f4-26d030eb9302 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:39.722617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-965b2d2c-3118-4f86-a3f4-26d030eb9302 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:39.729358 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-965b2d2c-3118-4f86-a3f4-26d030eb9302 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:39.730365 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-965b2d2c-3118-4f86-a3f4-26d030eb9302 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:39.731243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-965b2d2c-3118-4f86-a3f4-26d030eb9302 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:39.731691 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-965b2d2c-3118-4f86-a3f4-26d030eb9302 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:39.747397 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e31b67d0-3a80-416f-9563-a86f68d9de69 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:39.747946 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e31b67d0-3a80-416f-9563-a86f68d9de69 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:39.758460 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e31b67d0-3a80-416f-9563-a86f68d9de69 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:39.760385 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e31b67d0-3a80-416f-9563-a86f68d9de69 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:39.761417 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e31b67d0-3a80-416f-9563-a86f68d9de69 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:39.762043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e31b67d0-3a80-416f-9563-a86f68d9de69 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:40.013184 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-965b2d2c-3118-4f86-a3f4-26d030eb9302 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:40.028371 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-965b2d2c-3118-4f86-a3f4-26d030eb9302 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.312579 Jul 25 08:46:40.044920 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 53/114] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:39 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:40.050678 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-6d42b316-87a5-465c-8092-adb38f312215 req-a3a30d59-ca44-4afb-8e26-746674419438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7", "name": "network-vif-plugged", "status": "completed", "tag": "de1515d4-bcfe-41ca-b713-85a3e00f3b9f"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:40.067156 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-6d42b316-87a5-465c-8092-adb38f312215 req-a3a30d59-ca44-4afb-8e26-746674419438 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:40.067965 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-6d42b316-87a5-465c-8092-adb38f312215 req-a3a30d59-ca44-4afb-8e26-746674419438 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:40.082131 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-6d42b316-87a5-465c-8092-adb38f312215 req-a3a30d59-ca44-4afb-8e26-746674419438 service nova] Creating event network-vif-plugged:de1515d4-bcfe-41ca-b713-85a3e00f3b9f for instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 on hv-cinder-85084 Jul 25 08:46:40.088093 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-6d42b316-87a5-465c-8092-adb38f312215 req-a3a30d59-ca44-4afb-8e26-746674419438 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040742 Jul 25 08:46:40.088980 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 54/115] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:40.098689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-93a2247d-b658-46f8-812d-70d69f42c5b2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:40.106951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-93a2247d-b658-46f8-812d-70d69f42c5b2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:40.124145 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a2247d-b658-46f8-812d-70d69f42c5b2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:40.124888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a2247d-b658-46f8-812d-70d69f42c5b2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:40.125918 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a2247d-b658-46f8-812d-70d69f42c5b2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:40.126569 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a2247d-b658-46f8-812d-70d69f42c5b2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:40.192228 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e31b67d0-3a80-416f-9563-a86f68d9de69 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:40.204458 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e31b67d0-3a80-416f-9563-a86f68d9de69 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.460856 Jul 25 08:46:40.218010 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 62/116] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:39 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:40.248289 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-93a2247d-b658-46f8-812d-70d69f42c5b2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:40.258264 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-93a2247d-b658-46f8-812d-70d69f42c5b2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1299 microversion: 2.1 time: 0.163013 Jul 25 08:46:40.259151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 55/117] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:40 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1299 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:40.463045 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7bdcc7ea-cb86-4057-bb38-902a09df9de6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:40.463833 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7bdcc7ea-cb86-4057-bb38-902a09df9de6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:40.471162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7bdcc7ea-cb86-4057-bb38-902a09df9de6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:40.471929 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7bdcc7ea-cb86-4057-bb38-902a09df9de6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:40.472986 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7bdcc7ea-cb86-4057-bb38-902a09df9de6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:40.473509 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7bdcc7ea-cb86-4057-bb38-902a09df9de6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:40.493669 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=100 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:40.658358 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7bdcc7ea-cb86-4057-bb38-902a09df9de6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:40.667614 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7bdcc7ea-cb86-4057-bb38-902a09df9de6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.209337 Jul 25 08:46:40.668813 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 63/118] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:40 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:41.049372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4908fd0e-6318-48cc-9056-dee055018a3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:41.049958 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4908fd0e-6318-48cc-9056-dee055018a3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:41.056886 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4908fd0e-6318-48cc-9056-dee055018a3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:41.057345 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4908fd0e-6318-48cc-9056-dee055018a3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:41.058116 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4908fd0e-6318-48cc-9056-dee055018a3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:41.058760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4908fd0e-6318-48cc-9056-dee055018a3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:41.208152 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4908fd0e-6318-48cc-9056-dee055018a3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:41.216165 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4908fd0e-6318-48cc-9056-dee055018a3f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.170602 Jul 25 08:46:41.217528 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 56/119] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:41 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:41.246407 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-998411ce-1547-4a54-9bf6-fe333ddf22ac tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:41.249095 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-998411ce-1547-4a54-9bf6-fe333ddf22ac tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:41.255684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-998411ce-1547-4a54-9bf6-fe333ddf22ac tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:41.256131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-998411ce-1547-4a54-9bf6-fe333ddf22ac tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:41.257074 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-998411ce-1547-4a54-9bf6-fe333ddf22ac tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:41.257509 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-998411ce-1547-4a54-9bf6-fe333ddf22ac tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:41.281372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-408ec9a5-0155-4772-b639-2c9b0b5fbf18 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:41.282349 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-408ec9a5-0155-4772-b639-2c9b0b5fbf18 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:41.293869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-408ec9a5-0155-4772-b639-2c9b0b5fbf18 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:41.293869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-408ec9a5-0155-4772-b639-2c9b0b5fbf18 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:41.293869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-408ec9a5-0155-4772-b639-2c9b0b5fbf18 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:41.293869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-408ec9a5-0155-4772-b639-2c9b0b5fbf18 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:41.484278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-998411ce-1547-4a54-9bf6-fe333ddf22ac tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:41.493913 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-998411ce-1547-4a54-9bf6-fe333ddf22ac tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.261523 Jul 25 08:46:41.494877 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 64/120] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:41 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:41.521874 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-408ec9a5-0155-4772-b639-2c9b0b5fbf18 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:41.529193 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-408ec9a5-0155-4772-b639-2c9b0b5fbf18 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.253281 Jul 25 08:46:41.530302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 57/121] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:41 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:41.690199 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9dfe73ff-baa9-438b-8262-fba9c8eeb71e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:41.690845 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9dfe73ff-baa9-438b-8262-fba9c8eeb71e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:41.696991 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9dfe73ff-baa9-438b-8262-fba9c8eeb71e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:41.697520 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9dfe73ff-baa9-438b-8262-fba9c8eeb71e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:41.698447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9dfe73ff-baa9-438b-8262-fba9c8eeb71e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:41.699034 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9dfe73ff-baa9-438b-8262-fba9c8eeb71e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:41.847665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9dfe73ff-baa9-438b-8262-fba9c8eeb71e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:41.856111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9dfe73ff-baa9-438b-8262-fba9c8eeb71e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.170142 Jul 25 08:46:41.870654 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 65/122] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:41 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:42.239509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9d86aaa9-a691-422e-9174-b306a85c8490 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:42.240805 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9d86aaa9-a691-422e-9174-b306a85c8490 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:42.246858 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d86aaa9-a691-422e-9174-b306a85c8490 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:42.247303 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d86aaa9-a691-422e-9174-b306a85c8490 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:42.248052 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d86aaa9-a691-422e-9174-b306a85c8490 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:42.248772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d86aaa9-a691-422e-9174-b306a85c8490 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:42.414008 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9d86aaa9-a691-422e-9174-b306a85c8490 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:42.423194 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9d86aaa9-a691-422e-9174-b306a85c8490 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.187907 Jul 25 08:46:42.423762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 58/123] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:42 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:42.516975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-50df0510-d89a-4b4b-a6c0-fa7a0f83422c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:42.517591 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-50df0510-d89a-4b4b-a6c0-fa7a0f83422c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:42.527110 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50df0510-d89a-4b4b-a6c0-fa7a0f83422c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:42.527560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50df0510-d89a-4b4b-a6c0-fa7a0f83422c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:42.528849 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50df0510-d89a-4b4b-a6c0-fa7a0f83422c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:42.529688 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50df0510-d89a-4b4b-a6c0-fa7a0f83422c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:42.551580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-806af625-2d1d-43d9-852f-60656f1f48bd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:42.552195 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-806af625-2d1d-43d9-852f-60656f1f48bd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:42.555434 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:42.562729 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-806af625-2d1d-43d9-852f-60656f1f48bd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:42.563207 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-806af625-2d1d-43d9-852f-60656f1f48bd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:42.563971 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-806af625-2d1d-43d9-852f-60656f1f48bd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:42.564412 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-806af625-2d1d-43d9-852f-60656f1f48bd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:42.778464 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-50df0510-d89a-4b4b-a6c0-fa7a0f83422c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:42.782482 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-806af625-2d1d-43d9-852f-60656f1f48bd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:42.786716 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-50df0510-d89a-4b4b-a6c0-fa7a0f83422c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.274406 Jul 25 08:46:42.788703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 66/124] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:42 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:42.803553 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-806af625-2d1d-43d9-852f-60656f1f48bd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.256377 Jul 25 08:46:42.804789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 59/125] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:42 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:42.877901 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-02dc7e9b-07cc-47e2-9ea6-4073c4033021 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:42.878619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-02dc7e9b-07cc-47e2-9ea6-4073c4033021 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:42.885553 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-02dc7e9b-07cc-47e2-9ea6-4073c4033021 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:42.886115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-02dc7e9b-07cc-47e2-9ea6-4073c4033021 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:42.887469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-02dc7e9b-07cc-47e2-9ea6-4073c4033021 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:42.888033 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-02dc7e9b-07cc-47e2-9ea6-4073c4033021 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:43.077292 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-02dc7e9b-07cc-47e2-9ea6-4073c4033021 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:43.087564 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-02dc7e9b-07cc-47e2-9ea6-4073c4033021 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.214025 Jul 25 08:46:43.088187 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 67/126] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:42 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:43.445379 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8ff7d9b2-83d7-46ca-b803-ed5629fcafff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:43.445990 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8ff7d9b2-83d7-46ca-b803-ed5629fcafff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:43.452673 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8ff7d9b2-83d7-46ca-b803-ed5629fcafff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:43.453122 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8ff7d9b2-83d7-46ca-b803-ed5629fcafff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:43.453888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8ff7d9b2-83d7-46ca-b803-ed5629fcafff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:43.454346 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8ff7d9b2-83d7-46ca-b803-ed5629fcafff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:43.646645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8ff7d9b2-83d7-46ca-b803-ed5629fcafff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:43.656229 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8ff7d9b2-83d7-46ca-b803-ed5629fcafff tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.214829 Jul 25 08:46:43.671539 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 60/127] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:43 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:43.813116 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5e4fd326-6d73-4933-9a34-71441fac5576 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:43.817991 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5e4fd326-6d73-4933-9a34-71441fac5576 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:43.826018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5e4fd326-6d73-4933-9a34-71441fac5576 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:43.826206 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-91047afc-2b7c-469f-bbd4-eb0768078950 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:43.826905 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-91047afc-2b7c-469f-bbd4-eb0768078950 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:43.829297 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5e4fd326-6d73-4933-9a34-71441fac5576 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:43.831504 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5e4fd326-6d73-4933-9a34-71441fac5576 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:43.832332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5e4fd326-6d73-4933-9a34-71441fac5576 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:43.835302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91047afc-2b7c-469f-bbd4-eb0768078950 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:43.835775 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91047afc-2b7c-469f-bbd4-eb0768078950 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:43.837010 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91047afc-2b7c-469f-bbd4-eb0768078950 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:43.837481 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91047afc-2b7c-469f-bbd4-eb0768078950 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:44.138254 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-91047afc-2b7c-469f-bbd4-eb0768078950 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:44.152444 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-91047afc-2b7c-469f-bbd4-eb0768078950 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.331650 Jul 25 08:46:44.153735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 61/128] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:43 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:44.171385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f56d79f3-9276-4dc3-b6d4-d59cec9bcdb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:44.172288 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f56d79f3-9276-4dc3-b6d4-d59cec9bcdb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:44.179332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f56d79f3-9276-4dc3-b6d4-d59cec9bcdb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:44.179977 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f56d79f3-9276-4dc3-b6d4-d59cec9bcdb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:44.181138 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f56d79f3-9276-4dc3-b6d4-d59cec9bcdb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:44.181576 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f56d79f3-9276-4dc3-b6d4-d59cec9bcdb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:44.182379 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5e4fd326-6d73-4933-9a34-71441fac5576 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:44.194903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5e4fd326-6d73-4933-9a34-71441fac5576 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.391291 Jul 25 08:46:44.197467 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 68/129] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:43 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:44.368616 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f56d79f3-9276-4dc3-b6d4-d59cec9bcdb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:44.377561 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f56d79f3-9276-4dc3-b6d4-d59cec9bcdb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.222111 Jul 25 08:46:44.378136 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 62/130] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:44 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:44.677961 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6d0337d3-b02a-417b-96da-4a3187878574 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:44.678671 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6d0337d3-b02a-417b-96da-4a3187878574 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:44.700771 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=94 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:44.714314 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6d0337d3-b02a-417b-96da-4a3187878574 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:44.718452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6d0337d3-b02a-417b-96da-4a3187878574 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:44.719342 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6d0337d3-b02a-417b-96da-4a3187878574 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:44.721251 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6d0337d3-b02a-417b-96da-4a3187878574 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:44.996952 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-6d0337d3-b02a-417b-96da-4a3187878574 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:45.009151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-7b3cb745-9a2d-4a8e-95e9-98161ddf6ae8 req-4535f12f-33c4-4ac5-9f33-951df7fc7b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51386e27-02e7-4b3c-8a7a-a13ede11e75e", "tag": "653cd8da-6a1d-469a-82fe-d6dbe5f44308"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:45.034814 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6d0337d3-b02a-417b-96da-4a3187878574 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.361395 Jul 25 08:46:45.035428 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 69/131] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:44 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:45.041039 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7b3cb745-9a2d-4a8e-95e9-98161ddf6ae8 req-4535f12f-33c4-4ac5-9f33-951df7fc7b34 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:45.041486 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7b3cb745-9a2d-4a8e-95e9-98161ddf6ae8 req-4535f12f-33c4-4ac5-9f33-951df7fc7b34 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:45.084285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-7b3cb745-9a2d-4a8e-95e9-98161ddf6ae8 req-4535f12f-33c4-4ac5-9f33-951df7fc7b34 service nova] Creating event network-changed:653cd8da-6a1d-469a-82fe-d6dbe5f44308 for instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e on hv-cinder-85084 Jul 25 08:46:45.092625 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-7b3cb745-9a2d-4a8e-95e9-98161ddf6ae8 req-4535f12f-33c4-4ac5-9f33-951df7fc7b34 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087953 Jul 25 08:46:45.093514 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 63/132] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:45.177446 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0ed377ba-f5d7-4288-954a-e6e045eea45e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:45.178421 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0ed377ba-f5d7-4288-954a-e6e045eea45e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:45.192187 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0ed377ba-f5d7-4288-954a-e6e045eea45e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:45.193579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0ed377ba-f5d7-4288-954a-e6e045eea45e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:45.194554 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0ed377ba-f5d7-4288-954a-e6e045eea45e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:45.195386 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0ed377ba-f5d7-4288-954a-e6e045eea45e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:45.219275 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-be26d588-419c-4b14-82a9-bd029f41a506 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:45.220024 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-be26d588-419c-4b14-82a9-bd029f41a506 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:45.232209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be26d588-419c-4b14-82a9-bd029f41a506 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:45.233432 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be26d588-419c-4b14-82a9-bd029f41a506 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:45.234236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be26d588-419c-4b14-82a9-bd029f41a506 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:45.235311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be26d588-419c-4b14-82a9-bd029f41a506 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:45.667869 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0ed377ba-f5d7-4288-954a-e6e045eea45e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:45.682562 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0ed377ba-f5d7-4288-954a-e6e045eea45e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.510954 Jul 25 08:46:45.684603 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 70/133] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:45 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:45.691957 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0f163127-ee75-4685-8a41-a8b7e3cccc79 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:45.692825 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0f163127-ee75-4685-8a41-a8b7e3cccc79 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:45.705727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0f163127-ee75-4685-8a41-a8b7e3cccc79 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:45.706189 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0f163127-ee75-4685-8a41-a8b7e3cccc79 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:45.706976 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0f163127-ee75-4685-8a41-a8b7e3cccc79 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:45.707415 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0f163127-ee75-4685-8a41-a8b7e3cccc79 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:45.721641 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-be26d588-419c-4b14-82a9-bd029f41a506 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:45.732753 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-be26d588-419c-4b14-82a9-bd029f41a506 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.518036 Jul 25 08:46:45.733558 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 64/134] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:45 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:45.967553 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0f163127-ee75-4685-8a41-a8b7e3cccc79 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:45.986080 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0f163127-ee75-4685-8a41-a8b7e3cccc79 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.294251 Jul 25 08:46:45.987676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 71/135] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:45 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:46.059955 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-22a680c8-8389-49a5-88c6-d9f82d1f287d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:46.061310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-22a680c8-8389-49a5-88c6-d9f82d1f287d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:46.070614 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22a680c8-8389-49a5-88c6-d9f82d1f287d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:46.071426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22a680c8-8389-49a5-88c6-d9f82d1f287d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:46.072912 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22a680c8-8389-49a5-88c6-d9f82d1f287d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:46.073579 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22a680c8-8389-49a5-88c6-d9f82d1f287d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:46.182276 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-dcc0ddaa-8903-4e16-91b5-acdf8675640b req-c1e42e2c-84aa-4c99-ab3d-23ac6bc6633f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b16067-f13e-472e-a335-bbb66b7461b1", "name": "network-vif-plugged", "status": "completed", "tag": "4e4d0870-3b4e-4551-b50c-c4f668b497de"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:46.212130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-dcc0ddaa-8903-4e16-91b5-acdf8675640b req-c1e42e2c-84aa-4c99-ab3d-23ac6bc6633f service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:46.212909 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-dcc0ddaa-8903-4e16-91b5-acdf8675640b req-c1e42e2c-84aa-4c99-ab3d-23ac6bc6633f service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:46.230859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-dcc0ddaa-8903-4e16-91b5-acdf8675640b req-c1e42e2c-84aa-4c99-ab3d-23ac6bc6633f service nova] Creating event network-vif-plugged:4e4d0870-3b4e-4551-b50c-c4f668b497de for instance 22b16067-f13e-472e-a335-bbb66b7461b1 on hv-cinder-85084 Jul 25 08:46:46.236544 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-dcc0ddaa-8903-4e16-91b5-acdf8675640b req-c1e42e2c-84aa-4c99-ab3d-23ac6bc6633f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083107 Jul 25 08:46:46.237758 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 72/136] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:46.306871 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-22a680c8-8389-49a5-88c6-d9f82d1f287d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:46.316119 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-22a680c8-8389-49a5-88c6-d9f82d1f287d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.261396 Jul 25 08:46:46.317248 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 65/137] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:46 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:46.707005 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-65e2cee3-fdcf-49c4-9994-3026053e0673 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:46.708306 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-65e2cee3-fdcf-49c4-9994-3026053e0673 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:46.715143 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65e2cee3-fdcf-49c4-9994-3026053e0673 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:46.715593 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65e2cee3-fdcf-49c4-9994-3026053e0673 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:46.716676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65e2cee3-fdcf-49c4-9994-3026053e0673 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:46.717311 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65e2cee3-fdcf-49c4-9994-3026053e0673 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:46.757667 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-78a8444e-0066-429a-b4f8-b936973a912d tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:46.758347 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-78a8444e-0066-429a-b4f8-b936973a912d tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:46.771398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78a8444e-0066-429a-b4f8-b936973a912d tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:46.773028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78a8444e-0066-429a-b4f8-b936973a912d tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:46.774283 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78a8444e-0066-429a-b4f8-b936973a912d tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:46.774932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78a8444e-0066-429a-b4f8-b936973a912d tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:47.040433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-65e2cee3-fdcf-49c4-9994-3026053e0673 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:47.051652 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-65e2cee3-fdcf-49c4-9994-3026053e0673 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.349861 Jul 25 08:46:47.053426 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 73/138] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:46 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:47.063606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-816db4d4-3612-469c-bd28-3cc714e2026a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:47.064231 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-816db4d4-3612-469c-bd28-3cc714e2026a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:47.083115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-816db4d4-3612-469c-bd28-3cc714e2026a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:47.083662 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-816db4d4-3612-469c-bd28-3cc714e2026a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:47.084501 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-816db4d4-3612-469c-bd28-3cc714e2026a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:47.085809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-816db4d4-3612-469c-bd28-3cc714e2026a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:47.247033 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-78a8444e-0066-429a-b4f8-b936973a912d tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:47.267867 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-78a8444e-0066-429a-b4f8-b936973a912d tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.510207 Jul 25 08:46:47.269232 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 66/139] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:46 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:47.338755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ff392c0a-81e3-439a-80e9-8ef9949fec47 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:47.339380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ff392c0a-81e3-439a-80e9-8ef9949fec47 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:47.351226 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff392c0a-81e3-439a-80e9-8ef9949fec47 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:47.351857 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff392c0a-81e3-439a-80e9-8ef9949fec47 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:47.353074 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff392c0a-81e3-439a-80e9-8ef9949fec47 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:47.353507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff392c0a-81e3-439a-80e9-8ef9949fec47 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:47.558787 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-816db4d4-3612-469c-bd28-3cc714e2026a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:47.567284 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-816db4d4-3612-469c-bd28-3cc714e2026a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1322 microversion: 2.1 time: 0.511387 Jul 25 08:46:47.572294 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 74/140] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:47 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:47.615129 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ff392c0a-81e3-439a-80e9-8ef9949fec47 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:47.624944 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ff392c0a-81e3-439a-80e9-8ef9949fec47 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.289812 Jul 25 08:46:47.630802 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 67/141] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:47 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:48.077633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9d706bb9-ff06-494b-b71a-08073753c231 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:48.078280 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9d706bb9-ff06-494b-b71a-08073753c231 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:48.112478 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9d706bb9-ff06-494b-b71a-08073753c231 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:48.118057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9d706bb9-ff06-494b-b71a-08073753c231 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:48.120517 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9d706bb9-ff06-494b-b71a-08073753c231 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:48.121123 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9d706bb9-ff06-494b-b71a-08073753c231 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:48.293772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-355d2539-af33-4a45-a844-fb7327144341 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:48.298843 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-355d2539-af33-4a45-a844-fb7327144341 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:48.310574 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-355d2539-af33-4a45-a844-fb7327144341 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:48.311035 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-355d2539-af33-4a45-a844-fb7327144341 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:48.311818 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-355d2539-af33-4a45-a844-fb7327144341 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:48.317160 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-355d2539-af33-4a45-a844-fb7327144341 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:48.327615 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9d706bb9-ff06-494b-b71a-08073753c231 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:48.335669 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9d706bb9-ff06-494b-b71a-08073753c231 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.262537 Jul 25 08:46:48.350080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:48.352280 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 75/142] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:48 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:48.535015 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-170147542", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "networks": [{"uuid": "df2c555e-a7b1-4886-b8d4-ee1799973637"}]}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:48.601881 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-355d2539-af33-4a45-a844-fb7327144341 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:48.605607 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.network.neutron [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] validate_networks() for [('df2c555e-a7b1-4886-b8d4-ee1799973637', None, None, None, None, None)] {{(pid=124234) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:46:48.610950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-355d2539-af33-4a45-a844-fb7327144341 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.320300 Jul 25 08:46:48.611572 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 68/143] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:48 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:48.616395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7f1e7eb2-bc02-4ca4-abce-76ec923b91c2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:48.617794 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7f1e7eb2-bc02-4ca4-abce-76ec923b91c2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:48.624161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f1e7eb2-bc02-4ca4-abce-76ec923b91c2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:48.624905 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f1e7eb2-bc02-4ca4-abce-76ec923b91c2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:48.625670 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f1e7eb2-bc02-4ca4-abce-76ec923b91c2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:48.626263 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f1e7eb2-bc02-4ca4-abce-76ec923b91c2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:49.083396 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7f1e7eb2-bc02-4ca4-abce-76ec923b91c2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:49.103541 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7f1e7eb2-bc02-4ca4-abce-76ec923b91c2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1516 microversion: 2.1 time: 0.490684 Jul 25 08:46:49.104293 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 69/144] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:48 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1516 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:49.117082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-caab12f6-0056-474d-8c9d-c3ea9b9bd34f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:49.118649 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-caab12f6-0056-474d-8c9d-c3ea9b9bd34f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:49.133271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-caab12f6-0056-474d-8c9d-c3ea9b9bd34f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:49.133271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-caab12f6-0056-474d-8c9d-c3ea9b9bd34f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:49.133271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-caab12f6-0056-474d-8c9d-c3ea9b9bd34f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:49.133271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-caab12f6-0056-474d-8c9d-c3ea9b9bd34f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:49.408641 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-caab12f6-0056-474d-8c9d-c3ea9b9bd34f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:49.426180 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-caab12f6-0056-474d-8c9d-c3ea9b9bd34f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1364 microversion: 2.1 time: 0.319546 Jul 25 08:46:49.426772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 70/145] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:49 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:49.431679 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2f89e209-b1b6-4c2a-8e1c-63e129eedc60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:49.433965 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2f89e209-b1b6-4c2a-8e1c-63e129eedc60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:49.447315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2f89e209-b1b6-4c2a-8e1c-63e129eedc60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:49.447858 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2f89e209-b1b6-4c2a-8e1c-63e129eedc60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:49.457703 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2f89e209-b1b6-4c2a-8e1c-63e129eedc60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:49.458384 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2f89e209-b1b6-4c2a-8e1c-63e129eedc60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:49.585312 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-2f89e209-b1b6-4c2a-8e1c-63e129eedc60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lazy-loading 'flavor' on Instance uuid 71a72735-dc04-46c8-93bb-0ac441aed151 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:46:49.842580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2f89e209-b1b6-4c2a-8e1c-63e129eedc60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151/action" status: 200 len: 32 microversion: 2.1 time: 0.414028 Jul 25 08:46:49.844872 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 71/146] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:46:49 2022] POST /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151/action => generated 32 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:46:49.866792 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a459ef8f-9401-4832-97f3-8878b8699d8c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:49.870043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a459ef8f-9401-4832-97f3-8878b8699d8c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:49.916160 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a459ef8f-9401-4832-97f3-8878b8699d8c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:49.919022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a459ef8f-9401-4832-97f3-8878b8699d8c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:49.920410 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a459ef8f-9401-4832-97f3-8878b8699d8c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:49.923996 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a459ef8f-9401-4832-97f3-8878b8699d8c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:49.941144 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Flavor limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:46:49.941627 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Image limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:46:49.942005 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Flavor pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:46:49.942424 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Image pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:46:49.943666 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:46:49.980817 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:49.981363 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:49.987465 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:49.988086 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:50.052649 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Getting quotas for project d358c71209624c55b7db08cc3435dbcb. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:46:50.064450 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Getting quotas for user bf0c0131372345e6b23260b466ec8ff9 and project d358c71209624c55b7db08cc3435dbcb. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:46:50.078346 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Going to run 1 instances... {{(pid=124234) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:46:50.081049 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124234) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:46:50.135091 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a459ef8f-9401-4832-97f3-8878b8699d8c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:50.145733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a459ef8f-9401-4832-97f3-8878b8699d8c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.295007 Jul 25 08:46:50.158835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 72/147] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:49 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:50.158835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b10f5fd2-9c4e-49ec-b5a0-8f6430e72791 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:50.158835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b10f5fd2-9c4e-49ec-b5a0-8f6430e72791 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:50.159320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4b6f49f4-4c61-4d16-833b-3c298efb1361 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.627867 Jul 25 08:46:50.159320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 76/148] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:46:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:46:50.162469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b10f5fd2-9c4e-49ec-b5a0-8f6430e72791 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:50.162921 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b10f5fd2-9c4e-49ec-b5a0-8f6430e72791 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:50.163855 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b10f5fd2-9c4e-49ec-b5a0-8f6430e72791 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:50.164289 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b10f5fd2-9c4e-49ec-b5a0-8f6430e72791 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:50.170727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6e5ea89c-3aaf-42e2-99d1-5f7136fd7cea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:50.171316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6e5ea89c-3aaf-42e2-99d1-5f7136fd7cea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:50.192589 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e5ea89c-3aaf-42e2-99d1-5f7136fd7cea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:50.193117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e5ea89c-3aaf-42e2-99d1-5f7136fd7cea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:50.193889 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e5ea89c-3aaf-42e2-99d1-5f7136fd7cea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:50.194319 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e5ea89c-3aaf-42e2-99d1-5f7136fd7cea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:50.629535 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b10f5fd2-9c4e-49ec-b5a0-8f6430e72791 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:50.650731 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b10f5fd2-9c4e-49ec-b5a0-8f6430e72791 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.500373 Jul 25 08:46:50.651699 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 73/149] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:50 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:50.662143 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c952e71e-6719-440d-b36a-7a8f9db232db tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:50.662764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c952e71e-6719-440d-b36a-7a8f9db232db tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:50.708427 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-6e5ea89c-3aaf-42e2-99d1-5f7136fd7cea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:50.723027 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6e5ea89c-3aaf-42e2-99d1-5f7136fd7cea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.562626 Jul 25 08:46:50.732870 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 77/150] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:50 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:50.741493 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6cd193cf-6a94-4279-9692-2dc6ad871e5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:50.746144 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6cd193cf-6a94-4279-9692-2dc6ad871e5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:50.749559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c952e71e-6719-440d-b36a-7a8f9db232db tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:50.757020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c952e71e-6719-440d-b36a-7a8f9db232db tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1213 microversion: 2.1 time: 0.104479 Jul 25 08:46:50.758451 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 74/151] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:50 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:50.772608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6cd193cf-6a94-4279-9692-2dc6ad871e5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:50.772608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6cd193cf-6a94-4279-9692-2dc6ad871e5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:50.772608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6cd193cf-6a94-4279-9692-2dc6ad871e5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:50.772608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6cd193cf-6a94-4279-9692-2dc6ad871e5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:51.150083 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-6cd193cf-6a94-4279-9692-2dc6ad871e5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:51.167017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2efef1a6-edfe-4f5d-93f1-ff3e73258186 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:51.167632 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2efef1a6-edfe-4f5d-93f1-ff3e73258186 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:51.171623 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6cd193cf-6a94-4279-9692-2dc6ad871e5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1551 microversion: 2.1 time: 0.425959 Jul 25 08:46:51.172295 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 78/152] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:50 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1551 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:51.175450 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2efef1a6-edfe-4f5d-93f1-ff3e73258186 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:51.175899 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2efef1a6-edfe-4f5d-93f1-ff3e73258186 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:51.176704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2efef1a6-edfe-4f5d-93f1-ff3e73258186 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:51.177143 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2efef1a6-edfe-4f5d-93f1-ff3e73258186 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:51.194173 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2c8fde94-a03a-4a42-87bf-a27f554bc3d5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:51.195316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2c8fde94-a03a-4a42-87bf-a27f554bc3d5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:51.207631 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2c8fde94-a03a-4a42-87bf-a27f554bc3d5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:51.209308 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2c8fde94-a03a-4a42-87bf-a27f554bc3d5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:51.210255 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2c8fde94-a03a-4a42-87bf-a27f554bc3d5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:51.213652 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2c8fde94-a03a-4a42-87bf-a27f554bc3d5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:51.456018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2c8fde94-a03a-4a42-87bf-a27f554bc3d5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.265915 Jul 25 08:46:51.467844 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 79/153] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Jul 25 08:46:51 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:46:51.551666 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2efef1a6-edfe-4f5d-93f1-ff3e73258186 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:51.559109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2efef1a6-edfe-4f5d-93f1-ff3e73258186 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.396252 Jul 25 08:46:51.559602 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 75/154] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:51 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:51.684837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bc832b15-d2f5-4913-a54b-914d4a112371 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:51.686934 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bc832b15-d2f5-4913-a54b-914d4a112371 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:51.695635 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc832b15-d2f5-4913-a54b-914d4a112371 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:51.696321 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc832b15-d2f5-4913-a54b-914d4a112371 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:51.697116 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc832b15-d2f5-4913-a54b-914d4a112371 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:51.697538 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc832b15-d2f5-4913-a54b-914d4a112371 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:51.758106 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2960b005-09f0-421d-badc-5d3f03fd29ed tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:51.759230 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2960b005-09f0-421d-badc-5d3f03fd29ed tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:51.768863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2960b005-09f0-421d-badc-5d3f03fd29ed tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:51.769466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2960b005-09f0-421d-badc-5d3f03fd29ed tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:51.770942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2960b005-09f0-421d-badc-5d3f03fd29ed tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:51.771548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2960b005-09f0-421d-badc-5d3f03fd29ed tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:52.182816 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bc832b15-d2f5-4913-a54b-914d4a112371 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:52.200974 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bc832b15-d2f5-4913-a54b-914d4a112371 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.532904 Jul 25 08:46:52.214605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 80/155] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:51 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:52.232997 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a5e99194-35b4-4be0-9fc6-b16a7231e053 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:52.233862 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a5e99194-35b4-4be0-9fc6-b16a7231e053 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:52.244165 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5e99194-35b4-4be0-9fc6-b16a7231e053 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:52.247094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5e99194-35b4-4be0-9fc6-b16a7231e053 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:52.248149 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5e99194-35b4-4be0-9fc6-b16a7231e053 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:52.249077 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5e99194-35b4-4be0-9fc6-b16a7231e053 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:52.730169 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a5e99194-35b4-4be0-9fc6-b16a7231e053 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:52.734592 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=100 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:52.740895 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a5e99194-35b4-4be0-9fc6-b16a7231e053 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1265 microversion: 2.1 time: 0.524849 Jul 25 08:46:52.741696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 81/156] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:52 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1265 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:52.743367 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2960b005-09f0-421d-badc-5d3f03fd29ed tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:52.746759 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-bec87898-669f-4aaf-be99-a6492f5bade0 req-32ac55dd-2f37-4392-8f8b-8f8745d3d5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c47421d-f63c-4f50-97c9-fe01898702c2", "name": "network-vif-plugged", "status": "completed", "tag": "f611d792-f2ac-42c7-9f33-d791e3b88419"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:52.750936 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2960b005-09f0-421d-badc-5d3f03fd29ed tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.998389 Jul 25 08:46:52.751503 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 76/157] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:51 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:52.771472 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-134d4b9d-a038-4f09-bec5-54c921666f6e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:52.772107 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-bec87898-669f-4aaf-be99-a6492f5bade0 req-32ac55dd-2f37-4392-8f8b-8f8745d3d5aa service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:52.772315 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-bec87898-669f-4aaf-be99-a6492f5bade0 req-32ac55dd-2f37-4392-8f8b-8f8745d3d5aa service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:52.777697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-134d4b9d-a038-4f09-bec5-54c921666f6e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:52.792751 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-bec87898-669f-4aaf-be99-a6492f5bade0 req-32ac55dd-2f37-4392-8f8b-8f8745d3d5aa service nova] Creating event network-vif-plugged:f611d792-f2ac-42c7-9f33-d791e3b88419 for instance 1c47421d-f63c-4f50-97c9-fe01898702c2 on hv-cinder-85084 Jul 25 08:46:52.793312 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-134d4b9d-a038-4f09-bec5-54c921666f6e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:52.795887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-134d4b9d-a038-4f09-bec5-54c921666f6e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:52.796813 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-134d4b9d-a038-4f09-bec5-54c921666f6e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:52.797321 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-134d4b9d-a038-4f09-bec5-54c921666f6e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:52.804621 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-bec87898-669f-4aaf-be99-a6492f5bade0 req-32ac55dd-2f37-4392-8f8b-8f8745d3d5aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061407 Jul 25 08:46:52.809909 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 82/158] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:53.110166 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-134d4b9d-a038-4f09-bec5-54c921666f6e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:53.118632 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-134d4b9d-a038-4f09-bec5-54c921666f6e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.364266 Jul 25 08:46:53.119586 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 77/159] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:52 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:53.223532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-772fa7af-c0ab-4360-a133-3cc2df49a57b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:53.224846 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-772fa7af-c0ab-4360-a133-3cc2df49a57b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:53.238985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-772fa7af-c0ab-4360-a133-3cc2df49a57b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:53.240753 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-772fa7af-c0ab-4360-a133-3cc2df49a57b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:53.245191 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-772fa7af-c0ab-4360-a133-3cc2df49a57b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:53.245835 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-772fa7af-c0ab-4360-a133-3cc2df49a57b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:53.512299 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-772fa7af-c0ab-4360-a133-3cc2df49a57b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:53.521949 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-772fa7af-c0ab-4360-a133-3cc2df49a57b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.302743 Jul 25 08:46:53.532929 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 83/160] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:53 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:53.665152 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-fb53174b-861d-46f5-97b0-3f214fafc38c req-4ea9ee93-1544-48c2-8150-64ea0d0abba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7", "tag": "de1515d4-bcfe-41ca-b713-85a3e00f3b9f"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:46:53.674954 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-fb53174b-861d-46f5-97b0-3f214fafc38c req-4ea9ee93-1544-48c2-8150-64ea0d0abba1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:53.675252 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-fb53174b-861d-46f5-97b0-3f214fafc38c req-4ea9ee93-1544-48c2-8150-64ea0d0abba1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:53.688853 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-fb53174b-861d-46f5-97b0-3f214fafc38c req-4ea9ee93-1544-48c2-8150-64ea0d0abba1 service nova] Creating event network-changed:de1515d4-bcfe-41ca-b713-85a3e00f3b9f for instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 on hv-cinder-85084 Jul 25 08:46:53.694417 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-fb53174b-861d-46f5-97b0-3f214fafc38c req-4ea9ee93-1544-48c2-8150-64ea0d0abba1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032950 Jul 25 08:46:53.697864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 78/161] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:46:53.762415 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a3a8cff7-c801-411a-ab67-cddcb8d969a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:53.763993 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a3a8cff7-c801-411a-ab67-cddcb8d969a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:53.771442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a3a8cff7-c801-411a-ab67-cddcb8d969a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:53.772356 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a3a8cff7-c801-411a-ab67-cddcb8d969a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:53.773423 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a3a8cff7-c801-411a-ab67-cddcb8d969a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:53.774000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a3a8cff7-c801-411a-ab67-cddcb8d969a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:53.777318 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c5a4fea5-8f0d-4eac-a0f9-f18b484ddbb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:53.778212 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c5a4fea5-8f0d-4eac-a0f9-f18b484ddbb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:53.787848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5a4fea5-8f0d-4eac-a0f9-f18b484ddbb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:53.788381 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5a4fea5-8f0d-4eac-a0f9-f18b484ddbb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:53.789290 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5a4fea5-8f0d-4eac-a0f9-f18b484ddbb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:53.789797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5a4fea5-8f0d-4eac-a0f9-f18b484ddbb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:53.849647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a3a8cff7-c801-411a-ab67-cddcb8d969a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:53.858687 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a3a8cff7-c801-411a-ab67-cddcb8d969a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1271 microversion: 2.1 time: 0.101170 Jul 25 08:46:53.859273 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 84/162] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:53 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:53.962943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c5a4fea5-8f0d-4eac-a0f9-f18b484ddbb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:53.971437 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c5a4fea5-8f0d-4eac-a0f9-f18b484ddbb9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.198448 Jul 25 08:46:53.972319 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 79/163] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:53 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:54.143344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1216981a-6c88-4ce3-a85a-fe904af7f029 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:54.144194 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1216981a-6c88-4ce3-a85a-fe904af7f029 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:54.150863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1216981a-6c88-4ce3-a85a-fe904af7f029 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:54.151598 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1216981a-6c88-4ce3-a85a-fe904af7f029 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:54.152436 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1216981a-6c88-4ce3-a85a-fe904af7f029 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:54.152976 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1216981a-6c88-4ce3-a85a-fe904af7f029 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:54.308520 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1216981a-6c88-4ce3-a85a-fe904af7f029 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:54.317696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1216981a-6c88-4ce3-a85a-fe904af7f029 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.178141 Jul 25 08:46:54.318456 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 85/164] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:54 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:54.543309 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f70747ba-4ec7-464d-989f-e6d14fece09c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:54.544064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f70747ba-4ec7-464d-989f-e6d14fece09c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:54.550825 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f70747ba-4ec7-464d-989f-e6d14fece09c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:54.551272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f70747ba-4ec7-464d-989f-e6d14fece09c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:54.552035 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f70747ba-4ec7-464d-989f-e6d14fece09c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:54.552466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f70747ba-4ec7-464d-989f-e6d14fece09c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:54.700998 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f70747ba-4ec7-464d-989f-e6d14fece09c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:54.710257 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f70747ba-4ec7-464d-989f-e6d14fece09c tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.171484 Jul 25 08:46:54.711116 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 80/165] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:54 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:54.880793 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e6775266-0e39-4a06-9725-1bdad13a3580 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:54.880793 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e6775266-0e39-4a06-9725-1bdad13a3580 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:54.886327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e6775266-0e39-4a06-9725-1bdad13a3580 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:54.886776 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e6775266-0e39-4a06-9725-1bdad13a3580 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:54.887547 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e6775266-0e39-4a06-9725-1bdad13a3580 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:54.887981 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e6775266-0e39-4a06-9725-1bdad13a3580 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:54.956297 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e6775266-0e39-4a06-9725-1bdad13a3580 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:54.963830 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e6775266-0e39-4a06-9725-1bdad13a3580 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1271 microversion: 2.1 time: 0.088478 Jul 25 08:46:54.964444 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 86/166] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:54 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:54.992509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cb88a188-d181-4979-b0e3-321049ecdc80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:54.993464 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cb88a188-d181-4979-b0e3-321049ecdc80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:55.001390 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb88a188-d181-4979-b0e3-321049ecdc80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:55.002111 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb88a188-d181-4979-b0e3-321049ecdc80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:55.003037 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb88a188-d181-4979-b0e3-321049ecdc80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:55.003616 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb88a188-d181-4979-b0e3-321049ecdc80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:55.146826 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cb88a188-d181-4979-b0e3-321049ecdc80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:55.155173 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cb88a188-d181-4979-b0e3-321049ecdc80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.166449 Jul 25 08:46:55.155767 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 81/167] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:54 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:55.339411 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b5662d33-fb79-4e38-b193-912d93c7c489 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:55.340087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b5662d33-fb79-4e38-b193-912d93c7c489 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:55.347881 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5662d33-fb79-4e38-b193-912d93c7c489 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:55.348384 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5662d33-fb79-4e38-b193-912d93c7c489 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:55.349192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5662d33-fb79-4e38-b193-912d93c7c489 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:55.349632 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5662d33-fb79-4e38-b193-912d93c7c489 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:55.496565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b5662d33-fb79-4e38-b193-912d93c7c489 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:55.505483 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b5662d33-fb79-4e38-b193-912d93c7c489 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.170131 Jul 25 08:46:55.506048 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 87/168] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:55 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:55.731429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a3d15e7a-ddeb-472f-8bc2-30e95db10b55 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:55.732035 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a3d15e7a-ddeb-472f-8bc2-30e95db10b55 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:55.737976 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3d15e7a-ddeb-472f-8bc2-30e95db10b55 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:55.738417 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3d15e7a-ddeb-472f-8bc2-30e95db10b55 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:55.739173 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3d15e7a-ddeb-472f-8bc2-30e95db10b55 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:55.739600 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3d15e7a-ddeb-472f-8bc2-30e95db10b55 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:55.874387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a3d15e7a-ddeb-472f-8bc2-30e95db10b55 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:55.895728 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a3d15e7a-ddeb-472f-8bc2-30e95db10b55 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.167948 Jul 25 08:46:55.896302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 82/169] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:55 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:55.987876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-18c19955-267e-4edd-bedf-a65739d151ed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:55.988946 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-18c19955-267e-4edd-bedf-a65739d151ed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:55.998289 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-18c19955-267e-4edd-bedf-a65739d151ed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:55.998892 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-18c19955-267e-4edd-bedf-a65739d151ed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:55.999776 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-18c19955-267e-4edd-bedf-a65739d151ed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:56.000432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-18c19955-267e-4edd-bedf-a65739d151ed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:56.087453 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-18c19955-267e-4edd-bedf-a65739d151ed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:56.103516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-18c19955-267e-4edd-bedf-a65739d151ed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1271 microversion: 2.1 time: 0.121262 Jul 25 08:46:56.118821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 88/170] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:55 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:56.176112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e5c3213d-0c2c-43d5-a64a-29e742baccec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:56.176843 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e5c3213d-0c2c-43d5-a64a-29e742baccec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:56.183048 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5c3213d-0c2c-43d5-a64a-29e742baccec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:56.183496 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5c3213d-0c2c-43d5-a64a-29e742baccec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:56.184258 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5c3213d-0c2c-43d5-a64a-29e742baccec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:56.184872 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5c3213d-0c2c-43d5-a64a-29e742baccec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:56.528190 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-72605821-6331-4d5e-80c0-f8c6db86b2f3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:56.529447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-72605821-6331-4d5e-80c0-f8c6db86b2f3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:56.535655 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72605821-6331-4d5e-80c0-f8c6db86b2f3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:56.536409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72605821-6331-4d5e-80c0-f8c6db86b2f3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:56.537228 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72605821-6331-4d5e-80c0-f8c6db86b2f3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:56.537883 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72605821-6331-4d5e-80c0-f8c6db86b2f3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:56.648626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e5c3213d-0c2c-43d5-a64a-29e742baccec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:56.656659 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e5c3213d-0c2c-43d5-a64a-29e742baccec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.484489 Jul 25 08:46:56.657238 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 83/171] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:56 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:56.696287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-72605821-6331-4d5e-80c0-f8c6db86b2f3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:56.707790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-72605821-6331-4d5e-80c0-f8c6db86b2f3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.183956 Jul 25 08:46:56.708500 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 89/172] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:56 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:56.915987 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0ac7db91-4228-4635-8a73-41cef534a37e tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:56.916622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0ac7db91-4228-4635-8a73-41cef534a37e tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:56.923333 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ac7db91-4228-4635-8a73-41cef534a37e tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:56.923782 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ac7db91-4228-4635-8a73-41cef534a37e tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:56.924536 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ac7db91-4228-4635-8a73-41cef534a37e tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:56.924996 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ac7db91-4228-4635-8a73-41cef534a37e tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:56.940052 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:57.054547 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0ac7db91-4228-4635-8a73-41cef534a37e tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:57.061975 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0ac7db91-4228-4635-8a73-41cef534a37e tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.150091 Jul 25 08:46:57.062547 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 84/173] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:56 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:57.125293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ded77c02-5077-49c4-9f39-7d6ab889129f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:57.125858 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ded77c02-5077-49c4-9f39-7d6ab889129f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:57.131700 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ded77c02-5077-49c4-9f39-7d6ab889129f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:57.132168 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ded77c02-5077-49c4-9f39-7d6ab889129f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:57.132950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ded77c02-5077-49c4-9f39-7d6ab889129f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:57.133380 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ded77c02-5077-49c4-9f39-7d6ab889129f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:57.266207 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ded77c02-5077-49c4-9f39-7d6ab889129f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:57.275461 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ded77c02-5077-49c4-9f39-7d6ab889129f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.153865 Jul 25 08:46:57.276331 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 90/174] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:57 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:57.677953 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aee3e8ae-42bd-4961-9d9b-6dfe6b89e50f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:57.678550 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-aee3e8ae-42bd-4961-9d9b-6dfe6b89e50f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:57.685015 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aee3e8ae-42bd-4961-9d9b-6dfe6b89e50f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:57.685993 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aee3e8ae-42bd-4961-9d9b-6dfe6b89e50f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:57.686824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aee3e8ae-42bd-4961-9d9b-6dfe6b89e50f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:57.687317 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aee3e8ae-42bd-4961-9d9b-6dfe6b89e50f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:57.728243 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f834de1d-e21b-4262-b252-0dd313a4aff0 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:57.728924 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f834de1d-e21b-4262-b252-0dd313a4aff0 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:57.737313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f834de1d-e21b-4262-b252-0dd313a4aff0 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:57.737762 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f834de1d-e21b-4262-b252-0dd313a4aff0 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:57.738870 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f834de1d-e21b-4262-b252-0dd313a4aff0 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:57.739925 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f834de1d-e21b-4262-b252-0dd313a4aff0 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:57.925706 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-aee3e8ae-42bd-4961-9d9b-6dfe6b89e50f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:57.931900 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f834de1d-e21b-4262-b252-0dd313a4aff0 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:57.933450 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-aee3e8ae-42bd-4961-9d9b-6dfe6b89e50f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.259573 Jul 25 08:46:57.934186 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 85/175] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:57 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:57.939173 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f834de1d-e21b-4262-b252-0dd313a4aff0 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.214631 Jul 25 08:46:57.939727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 91/176] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:57 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:58.083355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-156fb255-7b21-4da9-9754-4ad48b454442 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:58.083959 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-156fb255-7b21-4da9-9754-4ad48b454442 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:58.090163 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-156fb255-7b21-4da9-9754-4ad48b454442 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:58.090624 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-156fb255-7b21-4da9-9754-4ad48b454442 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:58.092008 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-156fb255-7b21-4da9-9754-4ad48b454442 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:58.092446 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-156fb255-7b21-4da9-9754-4ad48b454442 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:58.220167 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-156fb255-7b21-4da9-9754-4ad48b454442 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:58.227477 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-156fb255-7b21-4da9-9754-4ad48b454442 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.148246 Jul 25 08:46:58.228048 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 86/177] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:58 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:58.300065 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f86af867-d4f2-4ec8-a1e4-4470f241ef83 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:58.300796 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f86af867-d4f2-4ec8-a1e4-4470f241ef83 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:58.306896 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f86af867-d4f2-4ec8-a1e4-4470f241ef83 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:58.307413 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f86af867-d4f2-4ec8-a1e4-4470f241ef83 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:58.308555 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f86af867-d4f2-4ec8-a1e4-4470f241ef83 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:58.308930 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f86af867-d4f2-4ec8-a1e4-4470f241ef83 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:58.437974 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f86af867-d4f2-4ec8-a1e4-4470f241ef83 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:58.446412 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f86af867-d4f2-4ec8-a1e4-4470f241ef83 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.150057 Jul 25 08:46:58.447001 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 92/178] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:58 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:58.955051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3d0d8e18-abfe-4ca1-806f-186899aeeabf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:58.956428 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3d0d8e18-abfe-4ca1-806f-186899aeeabf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:58.963807 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d0d8e18-abfe-4ca1-806f-186899aeeabf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:58.964260 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d0d8e18-abfe-4ca1-806f-186899aeeabf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:58.965060 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d0d8e18-abfe-4ca1-806f-186899aeeabf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:58.965498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d0d8e18-abfe-4ca1-806f-186899aeeabf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:58.969232 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f8c6d556-f54c-4d8a-a361-2eecc71eed74 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:58.971367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f8c6d556-f54c-4d8a-a361-2eecc71eed74 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:58.979031 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8c6d556-f54c-4d8a-a361-2eecc71eed74 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:58.979487 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8c6d556-f54c-4d8a-a361-2eecc71eed74 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:58.980291 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8c6d556-f54c-4d8a-a361-2eecc71eed74 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:58.980763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8c6d556-f54c-4d8a-a361-2eecc71eed74 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:59.445214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3d0d8e18-abfe-4ca1-806f-186899aeeabf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:59.469044 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3d0d8e18-abfe-4ca1-806f-186899aeeabf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.504719 Jul 25 08:46:59.469044 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 87/179] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:58 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:59.469246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f8c6d556-f54c-4d8a-a361-2eecc71eed74 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:59.469354 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-be73bed0-28c3-42ff-993b-ed424f28076b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:59.469354 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-be73bed0-28c3-42ff-993b-ed424f28076b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:59.469683 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f8c6d556-f54c-4d8a-a361-2eecc71eed74 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.511710 Jul 25 08:46:59.469683 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 93/180] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:58 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:46:59.477735 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dc44c150-3fc0-4478-a4a0-b6a424e251ef tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:46:59.478532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dc44c150-3fc0-4478-a4a0-b6a424e251ef tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:46:59.484888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc44c150-3fc0-4478-a4a0-b6a424e251ef tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:59.485469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc44c150-3fc0-4478-a4a0-b6a424e251ef tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:59.485966 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be73bed0-28c3-42ff-993b-ed424f28076b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:59.486440 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc44c150-3fc0-4478-a4a0-b6a424e251ef tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:59.486976 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc44c150-3fc0-4478-a4a0-b6a424e251ef tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:59.487881 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be73bed0-28c3-42ff-993b-ed424f28076b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:59.488872 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be73bed0-28c3-42ff-993b-ed424f28076b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:46:59.489321 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be73bed0-28c3-42ff-993b-ed424f28076b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:46:59.721191 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dc44c150-3fc0-4478-a4a0-b6a424e251ef tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:59.735805 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dc44c150-3fc0-4478-a4a0-b6a424e251ef tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.261111 Jul 25 08:46:59.735805 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 94/181] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:59 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:46:59.743967 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-be73bed0-28c3-42ff-993b-ed424f28076b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:46:59.752869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-be73bed0-28c3-42ff-993b-ed424f28076b tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.295182 Jul 25 08:46:59.754243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 88/182] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:46:59 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:00.282098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-d7533b90-7c27-4d29-9405-5bd37d0e5caa req-d704fc3c-c93e-4d39-b795-be3d42818222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed67f4fd-63db-4f9b-ab28-af9e82586d31", "tag": "af97c14f-36bb-413e-890c-ffc2a2e5b384"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:47:00.311832 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:00.313152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=6 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:00.316060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-d7533b90-7c27-4d29-9405-5bd37d0e5caa req-d704fc3c-c93e-4d39-b795-be3d42818222 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:00.316709 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-d7533b90-7c27-4d29-9405-5bd37d0e5caa req-d704fc3c-c93e-4d39-b795-be3d42818222 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:00.330405 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-d7533b90-7c27-4d29-9405-5bd37d0e5caa req-d704fc3c-c93e-4d39-b795-be3d42818222 service nova] Creating event network-changed:af97c14f-36bb-413e-890c-ffc2a2e5b384 for instance ed67f4fd-63db-4f9b-ab28-af9e82586d31 on hv-cinder-85084 Jul 25 08:47:00.336961 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-d7533b90-7c27-4d29-9405-5bd37d0e5caa req-d704fc3c-c93e-4d39-b795-be3d42818222 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059372 Jul 25 08:47:00.337863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 95/183] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:47:00.479075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6af54045-0f14-469d-8696-c9b9cc9789f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:00.480252 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6af54045-0f14-469d-8696-c9b9cc9789f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:00.491535 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8c3abdba-e0d3-4fea-92e8-31873717210b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:00.492544 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-8c3abdba-e0d3-4fea-92e8-31873717210b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:00.512674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6af54045-0f14-469d-8696-c9b9cc9789f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:00.513326 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8c3abdba-e0d3-4fea-92e8-31873717210b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:00.513822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6af54045-0f14-469d-8696-c9b9cc9789f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:00.514407 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8c3abdba-e0d3-4fea-92e8-31873717210b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:00.515428 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6af54045-0f14-469d-8696-c9b9cc9789f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:00.516238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8c3abdba-e0d3-4fea-92e8-31873717210b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:00.517312 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6af54045-0f14-469d-8696-c9b9cc9789f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:00.518074 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8c3abdba-e0d3-4fea-92e8-31873717210b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:00.756219 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:00.851702 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8c3abdba-e0d3-4fea-92e8-31873717210b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:00.853928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6af54045-0f14-469d-8696-c9b9cc9789f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:00.874558 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6af54045-0f14-469d-8696-c9b9cc9789f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.398911 Jul 25 08:47:00.886078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8c3abdba-e0d3-4fea-92e8-31873717210b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.388944 Jul 25 08:47:00.900005 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 89/184] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:00 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:00.900340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 96/185] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:00 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:00.900434 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-f3c06988-90b1-460a-93b2-b808f441f153 req-516b3288-aea8-452c-8a40-f83095b622b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51386e27-02e7-4b3c-8a7a-a13ede11e75e", "name": "network-vif-plugged", "status": "completed", "tag": "653cd8da-6a1d-469a-82fe-d6dbe5f44308"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:47:00.900547 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-65484718-ffd5-4fff-9d61-1a8ed715b2a3 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:00.900547 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-65484718-ffd5-4fff-9d61-1a8ed715b2a3 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:00.903219 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65484718-ffd5-4fff-9d61-1a8ed715b2a3 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:00.904176 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65484718-ffd5-4fff-9d61-1a8ed715b2a3 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:00.905081 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65484718-ffd5-4fff-9d61-1a8ed715b2a3 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:00.905524 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65484718-ffd5-4fff-9d61-1a8ed715b2a3 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:00.907978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-f3c06988-90b1-460a-93b2-b808f441f153 req-516b3288-aea8-452c-8a40-f83095b622b2 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:00.908920 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-f3c06988-90b1-460a-93b2-b808f441f153 req-516b3288-aea8-452c-8a40-f83095b622b2 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:00.925310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-f3c06988-90b1-460a-93b2-b808f441f153 req-516b3288-aea8-452c-8a40-f83095b622b2 service nova] Creating event network-vif-plugged:653cd8da-6a1d-469a-82fe-d6dbe5f44308 for instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e on hv-cinder-85084 Jul 25 08:47:00.931908 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-f3c06988-90b1-460a-93b2-b808f441f153 req-516b3288-aea8-452c-8a40-f83095b622b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041471 Jul 25 08:47:00.932843 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 90/186] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:47:00.939852 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c66c40f7-a5b0-4f97-be6e-600f3c9b2b67 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:00.941691 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c66c40f7-a5b0-4f97-be6e-600f3c9b2b67 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:00.949415 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c66c40f7-a5b0-4f97-be6e-600f3c9b2b67 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:00.950214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c66c40f7-a5b0-4f97-be6e-600f3c9b2b67 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:00.951546 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c66c40f7-a5b0-4f97-be6e-600f3c9b2b67 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:00.953276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c66c40f7-a5b0-4f97-be6e-600f3c9b2b67 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:01.217983 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-65484718-ffd5-4fff-9d61-1a8ed715b2a3 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:01.228202 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-65484718-ffd5-4fff-9d61-1a8ed715b2a3 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.338139 Jul 25 08:47:01.229542 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 97/187] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:00 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:01.286245 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c66c40f7-a5b0-4f97-be6e-600f3c9b2b67 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:01.305169 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c66c40f7-a5b0-4f97-be6e-600f3c9b2b67 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1314 microversion: 2.1 time: 0.370735 Jul 25 08:47:01.305983 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 91/188] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:00 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:01.895230 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3f5810ea-b5b5-433e-bc63-4fc6c480bbd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:01.895837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3f5810ea-b5b5-433e-bc63-4fc6c480bbd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:01.901941 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f5810ea-b5b5-433e-bc63-4fc6c480bbd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:01.902386 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f5810ea-b5b5-433e-bc63-4fc6c480bbd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:01.903338 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f5810ea-b5b5-433e-bc63-4fc6c480bbd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:01.904623 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f5810ea-b5b5-433e-bc63-4fc6c480bbd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:01.908146 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d14069dd-4fe2-4830-9e43-e860514770ad tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:01.908957 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d14069dd-4fe2-4830-9e43-e860514770ad tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:01.915611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d14069dd-4fe2-4830-9e43-e860514770ad tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:01.916066 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d14069dd-4fe2-4830-9e43-e860514770ad tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:01.918191 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d14069dd-4fe2-4830-9e43-e860514770ad tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:01.919714 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d14069dd-4fe2-4830-9e43-e860514770ad tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:02.167156 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3f5810ea-b5b5-433e-bc63-4fc6c480bbd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:02.168741 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d14069dd-4fe2-4830-9e43-e860514770ad tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:02.179281 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3f5810ea-b5b5-433e-bc63-4fc6c480bbd9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.287725 Jul 25 08:47:02.179857 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 98/189] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:01 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:02.183431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d14069dd-4fe2-4830-9e43-e860514770ad tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.279515 Jul 25 08:47:02.184504 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 92/190] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:01 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:02.250002 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6046e89b-d855-422a-b649-462166b1bc68 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:02.250619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6046e89b-d855-422a-b649-462166b1bc68 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:02.257596 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6046e89b-d855-422a-b649-462166b1bc68 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:02.258236 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6046e89b-d855-422a-b649-462166b1bc68 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:02.259159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6046e89b-d855-422a-b649-462166b1bc68 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:02.259996 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6046e89b-d855-422a-b649-462166b1bc68 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:02.326948 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7ebafe65-df4c-4691-914f-6e3d40708fc4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:02.328280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7ebafe65-df4c-4691-914f-6e3d40708fc4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:02.338299 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ebafe65-df4c-4691-914f-6e3d40708fc4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:02.338954 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ebafe65-df4c-4691-914f-6e3d40708fc4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:02.339907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ebafe65-df4c-4691-914f-6e3d40708fc4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:02.340688 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ebafe65-df4c-4691-914f-6e3d40708fc4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:02.584271 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-6046e89b-d855-422a-b649-462166b1bc68 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:02.587927 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=100 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:02.594716 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6046e89b-d855-422a-b649-462166b1bc68 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.348934 Jul 25 08:47:02.595307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 99/191] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:02 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:02.644108 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7ebafe65-df4c-4691-914f-6e3d40708fc4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:02.656338 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7ebafe65-df4c-4691-914f-6e3d40708fc4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1500 microversion: 2.1 time: 0.334051 Jul 25 08:47:02.657155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 93/192] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:02 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1500 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:03.203055 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-07b83db1-d606-442c-bc8f-f7eb4ee0e5b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:03.205071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-07b83db1-d606-442c-bc8f-f7eb4ee0e5b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:03.215098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-07b83db1-d606-442c-bc8f-f7eb4ee0e5b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:03.215656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e6cf215e-7a9d-46af-900a-bad660272e5c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:03.216926 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-07b83db1-d606-442c-bc8f-f7eb4ee0e5b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:03.217042 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e6cf215e-7a9d-46af-900a-bad660272e5c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:03.217559 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-07b83db1-d606-442c-bc8f-f7eb4ee0e5b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:03.219024 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-07b83db1-d606-442c-bc8f-f7eb4ee0e5b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:03.226507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e6cf215e-7a9d-46af-900a-bad660272e5c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:03.226956 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e6cf215e-7a9d-46af-900a-bad660272e5c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:03.231668 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e6cf215e-7a9d-46af-900a-bad660272e5c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:03.232815 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e6cf215e-7a9d-46af-900a-bad660272e5c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:03.588465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e6cf215e-7a9d-46af-900a-bad660272e5c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:03.598419 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e6cf215e-7a9d-46af-900a-bad660272e5c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1367 microversion: 2.1 time: 0.388195 Jul 25 08:47:03.600456 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 94/193] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:03 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:03.620401 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-07b83db1-d606-442c-bc8f-f7eb4ee0e5b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:03.631789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-07b83db1-d606-442c-bc8f-f7eb4ee0e5b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.434458 Jul 25 08:47:03.631942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9cae8cae-ff98-4dc4-96ad-fac9679b329f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:03.632422 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9cae8cae-ff98-4dc4-96ad-fac9679b329f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:03.633440 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 100/194] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:03 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:03.641522 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9cae8cae-ff98-4dc4-96ad-fac9679b329f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:03.642157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9cae8cae-ff98-4dc4-96ad-fac9679b329f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:03.643613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9cae8cae-ff98-4dc4-96ad-fac9679b329f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:03.644198 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9cae8cae-ff98-4dc4-96ad-fac9679b329f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:03.839297 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9cae8cae-ff98-4dc4-96ad-fac9679b329f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:03.865097 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9cae8cae-ff98-4dc4-96ad-fac9679b329f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.250862 Jul 25 08:47:03.865699 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 95/195] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:03 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:04.115332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d0278839-009a-48a4-9585-8e1efeda0bdf tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90001b21-6c32-4c77-9ee1-b0627a0d3986"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:47:04.118591 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d0278839-009a-48a4-9585-8e1efeda0bdf tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:04.125902 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d0278839-009a-48a4-9585-8e1efeda0bdf tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:04.126253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d0278839-009a-48a4-9585-8e1efeda0bdf tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:04.127027 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d0278839-009a-48a4-9585-8e1efeda0bdf tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:04.127466 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d0278839-009a-48a4-9585-8e1efeda0bdf tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:04.618550 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-28629243-1fde-48e0-a366-425f2a557c90 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:04.619269 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-28629243-1fde-48e0-a366-425f2a557c90 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:04.626192 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28629243-1fde-48e0-a366-425f2a557c90 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:04.626716 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28629243-1fde-48e0-a366-425f2a557c90 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:04.627559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28629243-1fde-48e0-a366-425f2a557c90 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:04.628068 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28629243-1fde-48e0-a366-425f2a557c90 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:04.756211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-28629243-1fde-48e0-a366-425f2a557c90 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:04.764414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-28629243-1fde-48e0-a366-425f2a557c90 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1556 microversion: 2.1 time: 0.149952 Jul 25 08:47:04.764999 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 96/196] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:04 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:04.769492 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6b5c1649-905a-498a-aed2-a89d7e00ae17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:04.770087 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6b5c1649-905a-498a-aed2-a89d7e00ae17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:04.777077 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6b5c1649-905a-498a-aed2-a89d7e00ae17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:04.777543 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6b5c1649-905a-498a-aed2-a89d7e00ae17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:04.778271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6b5c1649-905a-498a-aed2-a89d7e00ae17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:04.778738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6b5c1649-905a-498a-aed2-a89d7e00ae17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:04.918403 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6b5c1649-905a-498a-aed2-a89d7e00ae17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:04.932242 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6b5c1649-905a-498a-aed2-a89d7e00ae17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.166159 Jul 25 08:47:04.932962 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 97/197] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:04 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:04.938517 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-49561fc5-2223-4138-bfdb-8b53f712cf6c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:04.939008 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-49561fc5-2223-4138-bfdb-8b53f712cf6c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:04.945237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-49561fc5-2223-4138-bfdb-8b53f712cf6c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:04.946113 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-49561fc5-2223-4138-bfdb-8b53f712cf6c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:04.947067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-49561fc5-2223-4138-bfdb-8b53f712cf6c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:04.947504 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-49561fc5-2223-4138-bfdb-8b53f712cf6c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:05.030550 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-49561fc5-2223-4138-bfdb-8b53f712cf6c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096390 Jul 25 08:47:05.031151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 98/198] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Jul 25 08:47:04 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:47:05.035585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c946648d-aa57-4591-9d8d-e52c8358118e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:05.036212 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c946648d-aa57-4591-9d8d-e52c8358118e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:05.042213 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c946648d-aa57-4591-9d8d-e52c8358118e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:05.042662 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c946648d-aa57-4591-9d8d-e52c8358118e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:05.043429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c946648d-aa57-4591-9d8d-e52c8358118e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:05.043908 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c946648d-aa57-4591-9d8d-e52c8358118e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:05.174836 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c946648d-aa57-4591-9d8d-e52c8358118e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:05.182299 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c946648d-aa57-4591-9d8d-e52c8358118e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.150192 Jul 25 08:47:05.182871 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 99/199] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:05 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:05.954387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-85f95b00-78b1-4e63-8de3-5f26a3233705 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:05.955043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-85f95b00-78b1-4e63-8de3-5f26a3233705 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:05.961287 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-85f95b00-78b1-4e63-8de3-5f26a3233705 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:05.961744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-85f95b00-78b1-4e63-8de3-5f26a3233705 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:05.962478 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-85f95b00-78b1-4e63-8de3-5f26a3233705 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:05.962919 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-85f95b00-78b1-4e63-8de3-5f26a3233705 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:06.104064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-85f95b00-78b1-4e63-8de3-5f26a3233705 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:06.114866 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-85f95b00-78b1-4e63-8de3-5f26a3233705 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.165346 Jul 25 08:47:06.124626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 100/200] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:05 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:06.205056 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2b373092-8538-46d4-b25d-bac9c0053d30 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:06.205982 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2b373092-8538-46d4-b25d-bac9c0053d30 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:06.212536 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b373092-8538-46d4-b25d-bac9c0053d30 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:06.213155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b373092-8538-46d4-b25d-bac9c0053d30 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:06.214061 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b373092-8538-46d4-b25d-bac9c0053d30 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:06.214634 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b373092-8538-46d4-b25d-bac9c0053d30 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:06.359167 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2b373092-8538-46d4-b25d-bac9c0053d30 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:06.366892 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2b373092-8538-46d4-b25d-bac9c0053d30 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.167363 Jul 25 08:47:06.371012 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 101/201] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:06 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:06.409728 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-7706ec64-2a7e-4cf3-ad13-aa4ac3ef0729 req-112f4155-c040-44ee-badf-1dd8f36f7f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51386e27-02e7-4b3c-8a7a-a13ede11e75e", "tag": "653cd8da-6a1d-469a-82fe-d6dbe5f44308"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:47:06.419854 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7706ec64-2a7e-4cf3-ad13-aa4ac3ef0729 req-112f4155-c040-44ee-badf-1dd8f36f7f2c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:06.420453 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7706ec64-2a7e-4cf3-ad13-aa4ac3ef0729 req-112f4155-c040-44ee-badf-1dd8f36f7f2c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:06.431109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:06.433039 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-7706ec64-2a7e-4cf3-ad13-aa4ac3ef0729 req-112f4155-c040-44ee-badf-1dd8f36f7f2c service nova] Creating event network-changed:653cd8da-6a1d-469a-82fe-d6dbe5f44308 for instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e on hv-cinder-85084 Jul 25 08:47:06.438788 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-7706ec64-2a7e-4cf3-ad13-aa4ac3ef0729 req-112f4155-c040-44ee-badf-1dd8f36f7f2c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032964 Jul 25 08:47:06.439764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 102/202] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:47:07.137629 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d898134e-713a-4363-b5fd-4ca4c7c6e7f6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:07.138815 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d898134e-713a-4363-b5fd-4ca4c7c6e7f6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:07.145468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d898134e-713a-4363-b5fd-4ca4c7c6e7f6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:07.145908 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d898134e-713a-4363-b5fd-4ca4c7c6e7f6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:07.146671 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d898134e-713a-4363-b5fd-4ca4c7c6e7f6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:07.147101 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d898134e-713a-4363-b5fd-4ca4c7c6e7f6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:07.283771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d898134e-713a-4363-b5fd-4ca4c7c6e7f6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:07.292188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d898134e-713a-4363-b5fd-4ca4c7c6e7f6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.159204 Jul 25 08:47:07.292975 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 103/203] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:07 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:07.388475 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f4e4e928-0c29-4c30-9013-d0c9dabf89a6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:07.388681 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f4e4e928-0c29-4c30-9013-d0c9dabf89a6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:07.396111 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4e4e928-0c29-4c30-9013-d0c9dabf89a6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:07.396555 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4e4e928-0c29-4c30-9013-d0c9dabf89a6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:07.397357 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4e4e928-0c29-4c30-9013-d0c9dabf89a6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:07.397876 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4e4e928-0c29-4c30-9013-d0c9dabf89a6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:07.528797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f4e4e928-0c29-4c30-9013-d0c9dabf89a6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:07.538671 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f4e4e928-0c29-4c30-9013-d0c9dabf89a6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.154781 Jul 25 08:47:07.540535 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 104/204] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:07 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:08.313540 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6d755aab-a463-4258-842b-1fa19c599e38 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:08.314182 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6d755aab-a463-4258-842b-1fa19c599e38 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:08.320247 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d755aab-a463-4258-842b-1fa19c599e38 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:08.320736 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d755aab-a463-4258-842b-1fa19c599e38 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:08.321492 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d755aab-a463-4258-842b-1fa19c599e38 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:08.321924 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d755aab-a463-4258-842b-1fa19c599e38 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:08.446724 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6d755aab-a463-4258-842b-1fa19c599e38 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:08.454627 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6d755aab-a463-4258-842b-1fa19c599e38 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.145427 Jul 25 08:47:08.455182 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 105/205] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:08 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:08.560445 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6ac36aed-6943-4012-bb77-edcbb54906c6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:08.561086 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6ac36aed-6943-4012-bb77-edcbb54906c6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:08.567110 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ac36aed-6943-4012-bb77-edcbb54906c6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:08.567553 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ac36aed-6943-4012-bb77-edcbb54906c6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:08.568307 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ac36aed-6943-4012-bb77-edcbb54906c6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:08.568864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ac36aed-6943-4012-bb77-edcbb54906c6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:08.701654 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6ac36aed-6943-4012-bb77-edcbb54906c6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:08.710054 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6ac36aed-6943-4012-bb77-edcbb54906c6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.153288 Jul 25 08:47:08.710626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 106/206] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:08 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:09.475054 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dead006e-86fc-4ac1-ad9f-c5a0c63e7508 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:09.475658 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dead006e-86fc-4ac1-ad9f-c5a0c63e7508 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:09.481727 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dead006e-86fc-4ac1-ad9f-c5a0c63e7508 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:09.482170 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dead006e-86fc-4ac1-ad9f-c5a0c63e7508 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:09.482909 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dead006e-86fc-4ac1-ad9f-c5a0c63e7508 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:09.483340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dead006e-86fc-4ac1-ad9f-c5a0c63e7508 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:09.609181 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dead006e-86fc-4ac1-ad9f-c5a0c63e7508 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:09.616732 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dead006e-86fc-4ac1-ad9f-c5a0c63e7508 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.145413 Jul 25 08:47:09.617290 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 107/207] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:09 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:09.730221 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-81d0de49-3a3e-423d-8b42-10a4b0d13cd8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:09.730814 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-81d0de49-3a3e-423d-8b42-10a4b0d13cd8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:09.732681 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:09.737972 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81d0de49-3a3e-423d-8b42-10a4b0d13cd8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:09.738412 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81d0de49-3a3e-423d-8b42-10a4b0d13cd8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:09.739153 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81d0de49-3a3e-423d-8b42-10a4b0d13cd8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:09.739578 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81d0de49-3a3e-423d-8b42-10a4b0d13cd8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:09.868680 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-81d0de49-3a3e-423d-8b42-10a4b0d13cd8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:09.876631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-81d0de49-3a3e-423d-8b42-10a4b0d13cd8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.150027 Jul 25 08:47:09.877243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 108/208] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:09 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:10.637158 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-943a9a71-989e-48fe-81c1-61e7a3616324 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:10.637826 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-943a9a71-989e-48fe-81c1-61e7a3616324 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:10.643972 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-943a9a71-989e-48fe-81c1-61e7a3616324 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:10.644421 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-943a9a71-989e-48fe-81c1-61e7a3616324 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:10.645215 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-943a9a71-989e-48fe-81c1-61e7a3616324 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:10.645647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-943a9a71-989e-48fe-81c1-61e7a3616324 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:10.783171 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-943a9a71-989e-48fe-81c1-61e7a3616324 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:10.793295 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-943a9a71-989e-48fe-81c1-61e7a3616324 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.160116 Jul 25 08:47:10.812516 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 109/209] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:10 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:10.897818 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-53836b3f-7560-4bcc-a91f-70df455a4389 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:10.898425 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-53836b3f-7560-4bcc-a91f-70df455a4389 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:10.904918 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53836b3f-7560-4bcc-a91f-70df455a4389 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:10.905361 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53836b3f-7560-4bcc-a91f-70df455a4389 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:10.906104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53836b3f-7560-4bcc-a91f-70df455a4389 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:10.906529 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53836b3f-7560-4bcc-a91f-70df455a4389 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:11.031016 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-53836b3f-7560-4bcc-a91f-70df455a4389 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:11.038431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-53836b3f-7560-4bcc-a91f-70df455a4389 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.144376 Jul 25 08:47:11.039016 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 110/210] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:10 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:11.814669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0f6c8fb6-b2b8-4835-a21a-9ed9751b0690 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:11.815298 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0f6c8fb6-b2b8-4835-a21a-9ed9751b0690 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:11.821402 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f6c8fb6-b2b8-4835-a21a-9ed9751b0690 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:11.821857 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f6c8fb6-b2b8-4835-a21a-9ed9751b0690 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:11.822628 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f6c8fb6-b2b8-4835-a21a-9ed9751b0690 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:11.823068 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f6c8fb6-b2b8-4835-a21a-9ed9751b0690 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:11.954818 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0f6c8fb6-b2b8-4835-a21a-9ed9751b0690 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:11.962199 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0f6c8fb6-b2b8-4835-a21a-9ed9751b0690 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.151474 Jul 25 08:47:11.962762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 111/211] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:11 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:12.058421 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3b77a48d-a76c-4d80-9d6d-92882233ea79 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:12.059019 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3b77a48d-a76c-4d80-9d6d-92882233ea79 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:12.064795 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3b77a48d-a76c-4d80-9d6d-92882233ea79 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:12.065179 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3b77a48d-a76c-4d80-9d6d-92882233ea79 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:12.065919 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3b77a48d-a76c-4d80-9d6d-92882233ea79 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:12.066349 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3b77a48d-a76c-4d80-9d6d-92882233ea79 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:12.192604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3b77a48d-a76c-4d80-9d6d-92882233ea79 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:12.199958 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3b77a48d-a76c-4d80-9d6d-92882233ea79 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.145085 Jul 25 08:47:12.200527 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 112/212] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:12 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:12.984066 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4985a9ab-1507-4af7-babc-d247d71fab06 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:12.984676 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4985a9ab-1507-4af7-babc-d247d71fab06 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:12.990789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4985a9ab-1507-4af7-babc-d247d71fab06 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:12.991250 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4985a9ab-1507-4af7-babc-d247d71fab06 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:12.992008 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4985a9ab-1507-4af7-babc-d247d71fab06 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:12.992445 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4985a9ab-1507-4af7-babc-d247d71fab06 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:13.122442 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4985a9ab-1507-4af7-babc-d247d71fab06 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:13.130123 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4985a9ab-1507-4af7-babc-d247d71fab06 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.150524 Jul 25 08:47:13.130692 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 113/213] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:12 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:13.220337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-905c3de0-28b2-4c65-a3fa-58d453039bbe tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:13.220984 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-905c3de0-28b2-4c65-a3fa-58d453039bbe tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:13.226924 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-905c3de0-28b2-4c65-a3fa-58d453039bbe tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:13.227373 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-905c3de0-28b2-4c65-a3fa-58d453039bbe tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:13.228127 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-905c3de0-28b2-4c65-a3fa-58d453039bbe tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:13.228562 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-905c3de0-28b2-4c65-a3fa-58d453039bbe tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:13.357053 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-905c3de0-28b2-4c65-a3fa-58d453039bbe tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:13.364360 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-905c3de0-28b2-4c65-a3fa-58d453039bbe tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.148393 Jul 25 08:47:13.364961 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 114/214] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:13 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:14.125938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:14.151025 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cd0029a9-84ef-4ac0-b3b2-a64d2057805a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:14.151635 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cd0029a9-84ef-4ac0-b3b2-a64d2057805a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:14.158356 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd0029a9-84ef-4ac0-b3b2-a64d2057805a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:14.158800 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd0029a9-84ef-4ac0-b3b2-a64d2057805a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:14.159561 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd0029a9-84ef-4ac0-b3b2-a64d2057805a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:14.159993 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd0029a9-84ef-4ac0-b3b2-a64d2057805a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:14.243585 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=12 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:14.289560 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cd0029a9-84ef-4ac0-b3b2-a64d2057805a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:14.297830 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cd0029a9-84ef-4ac0-b3b2-a64d2057805a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.150578 Jul 25 08:47:14.298397 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 115/215] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:14 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:14.385162 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e49b366b-0ad1-4368-a289-a0dcfe8cff66 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:14.385797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e49b366b-0ad1-4368-a289-a0dcfe8cff66 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:14.392307 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e49b366b-0ad1-4368-a289-a0dcfe8cff66 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:14.393191 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e49b366b-0ad1-4368-a289-a0dcfe8cff66 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:14.393950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e49b366b-0ad1-4368-a289-a0dcfe8cff66 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:14.394383 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e49b366b-0ad1-4368-a289-a0dcfe8cff66 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:14.522927 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e49b366b-0ad1-4368-a289-a0dcfe8cff66 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:14.530248 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e49b366b-0ad1-4368-a289-a0dcfe8cff66 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.149021 Jul 25 08:47:14.530814 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 116/216] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:14 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:15.320599 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8bd2eb9f-92e7-4667-9cfb-572b27728bd7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:15.321742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8bd2eb9f-92e7-4667-9cfb-572b27728bd7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:15.329623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bd2eb9f-92e7-4667-9cfb-572b27728bd7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:15.330076 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bd2eb9f-92e7-4667-9cfb-572b27728bd7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:15.330834 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bd2eb9f-92e7-4667-9cfb-572b27728bd7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:15.331269 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bd2eb9f-92e7-4667-9cfb-572b27728bd7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:15.457474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8bd2eb9f-92e7-4667-9cfb-572b27728bd7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:15.464890 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8bd2eb9f-92e7-4667-9cfb-572b27728bd7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.150461 Jul 25 08:47:15.465460 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 117/217] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:15 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:15.553812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7f84c468-5535-4299-bf29-876c32081ffd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:15.554746 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7f84c468-5535-4299-bf29-876c32081ffd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:15.561722 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f84c468-5535-4299-bf29-876c32081ffd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:15.562134 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f84c468-5535-4299-bf29-876c32081ffd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:15.562889 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f84c468-5535-4299-bf29-876c32081ffd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:15.563318 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f84c468-5535-4299-bf29-876c32081ffd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:15.694071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7f84c468-5535-4299-bf29-876c32081ffd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:15.701653 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7f84c468-5535-4299-bf29-876c32081ffd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.154613 Jul 25 08:47:15.702242 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 118/218] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:15 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:16.485972 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cd814993-3812-47d4-bba8-330e50a8d405 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:16.486610 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cd814993-3812-47d4-bba8-330e50a8d405 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:16.492502 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd814993-3812-47d4-bba8-330e50a8d405 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:16.492981 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd814993-3812-47d4-bba8-330e50a8d405 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:16.493738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd814993-3812-47d4-bba8-330e50a8d405 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:16.494173 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd814993-3812-47d4-bba8-330e50a8d405 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:16.508684 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:16.621850 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cd814993-3812-47d4-bba8-330e50a8d405 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:16.629300 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cd814993-3812-47d4-bba8-330e50a8d405 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.147774 Jul 25 08:47:16.629861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 119/219] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:16 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:16.721829 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9be5ae7d-ff38-45e5-98e4-6149011670b0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:16.722439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9be5ae7d-ff38-45e5-98e4-6149011670b0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:16.728288 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9be5ae7d-ff38-45e5-98e4-6149011670b0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:16.728785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9be5ae7d-ff38-45e5-98e4-6149011670b0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:16.729582 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9be5ae7d-ff38-45e5-98e4-6149011670b0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:16.730013 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9be5ae7d-ff38-45e5-98e4-6149011670b0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:16.857348 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9be5ae7d-ff38-45e5-98e4-6149011670b0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:16.864701 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9be5ae7d-ff38-45e5-98e4-6149011670b0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.146613 Jul 25 08:47:16.865267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 120/220] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:16 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:17.650921 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-024f053d-b068-413b-9ef4-922dfd1770e2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:17.651528 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-024f053d-b068-413b-9ef4-922dfd1770e2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:17.658047 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-024f053d-b068-413b-9ef4-922dfd1770e2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:17.658494 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-024f053d-b068-413b-9ef4-922dfd1770e2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:17.659254 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-024f053d-b068-413b-9ef4-922dfd1770e2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:17.659689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-024f053d-b068-413b-9ef4-922dfd1770e2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:17.784029 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-024f053d-b068-413b-9ef4-922dfd1770e2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:17.791571 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-024f053d-b068-413b-9ef4-922dfd1770e2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.144493 Jul 25 08:47:17.792128 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 121/221] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:17 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:17.885326 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cee980a7-0d51-4cc1-8789-d36d40d1bb33 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:17.885935 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cee980a7-0d51-4cc1-8789-d36d40d1bb33 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:17.892211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cee980a7-0d51-4cc1-8789-d36d40d1bb33 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:17.892694 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cee980a7-0d51-4cc1-8789-d36d40d1bb33 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:17.893450 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cee980a7-0d51-4cc1-8789-d36d40d1bb33 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:17.893880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cee980a7-0d51-4cc1-8789-d36d40d1bb33 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:18.020220 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cee980a7-0d51-4cc1-8789-d36d40d1bb33 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:18.027575 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cee980a7-0d51-4cc1-8789-d36d40d1bb33 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.146074 Jul 25 08:47:18.028162 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 122/222] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:17 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:18.237967 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d0278839-009a-48a4-9585-8e1efeda0bdf tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "POST /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.129586 Jul 25 08:47:18.238593 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 101/223] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:47:04 2022] POST /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2/os-volume_attachments => generated 194 bytes in 14131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:47:18.811543 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-18c70dd1-e75c-4bba-a803-54293dd7abdb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:18.812157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-18c70dd1-e75c-4bba-a803-54293dd7abdb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:18.818252 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-18c70dd1-e75c-4bba-a803-54293dd7abdb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:18.818701 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-18c70dd1-e75c-4bba-a803-54293dd7abdb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:18.819458 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-18c70dd1-e75c-4bba-a803-54293dd7abdb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:18.819891 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-18c70dd1-e75c-4bba-a803-54293dd7abdb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:18.947582 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-18c70dd1-e75c-4bba-a803-54293dd7abdb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:18.955602 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-18c70dd1-e75c-4bba-a803-54293dd7abdb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.148368 Jul 25 08:47:18.956251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 123/224] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:18 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:19.048685 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6e27ad50-25f7-4087-812c-a170283614b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:19.049583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6e27ad50-25f7-4087-812c-a170283614b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:19.056091 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e27ad50-25f7-4087-812c-a170283614b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:19.056653 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e27ad50-25f7-4087-812c-a170283614b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:19.057497 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e27ad50-25f7-4087-812c-a170283614b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:19.058025 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e27ad50-25f7-4087-812c-a170283614b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:19.189605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-6e27ad50-25f7-4087-812c-a170283614b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:19.197444 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6e27ad50-25f7-4087-812c-a170283614b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.153899 Jul 25 08:47:19.198010 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 102/225] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:19 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:19.975177 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-46cbcd02-40ec-4d62-a4be-03a83e57d86b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:19.975762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-46cbcd02-40ec-4d62-a4be-03a83e57d86b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:19.982304 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46cbcd02-40ec-4d62-a4be-03a83e57d86b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:19.982776 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46cbcd02-40ec-4d62-a4be-03a83e57d86b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:19.983527 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46cbcd02-40ec-4d62-a4be-03a83e57d86b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:19.983951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46cbcd02-40ec-4d62-a4be-03a83e57d86b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:20.112250 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-46cbcd02-40ec-4d62-a4be-03a83e57d86b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:20.119764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-46cbcd02-40ec-4d62-a4be-03a83e57d86b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.148438 Jul 25 08:47:20.120342 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 124/226] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:19 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:20.218046 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-be608ffc-993b-46f3-86fc-bab1ddb1e6a7 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:20.218658 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-be608ffc-993b-46f3-86fc-bab1ddb1e6a7 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:20.225095 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-be608ffc-993b-46f3-86fc-bab1ddb1e6a7 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:20.225611 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-be608ffc-993b-46f3-86fc-bab1ddb1e6a7 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:20.226315 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-be608ffc-993b-46f3-86fc-bab1ddb1e6a7 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:20.226750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-be608ffc-993b-46f3-86fc-bab1ddb1e6a7 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:20.352029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-be608ffc-993b-46f3-86fc-bab1ddb1e6a7 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:20.360178 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-be608ffc-993b-46f3-86fc-bab1ddb1e6a7 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.146229 Jul 25 08:47:20.360564 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 103/227] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:20 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:21.140816 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-faaa5423-a4ef-4aba-914a-48a3fa959ca6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:21.141433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-faaa5423-a4ef-4aba-914a-48a3fa959ca6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:21.147520 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-faaa5423-a4ef-4aba-914a-48a3fa959ca6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:21.147963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-faaa5423-a4ef-4aba-914a-48a3fa959ca6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:21.148751 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-faaa5423-a4ef-4aba-914a-48a3fa959ca6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:21.149182 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-faaa5423-a4ef-4aba-914a-48a3fa959ca6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:21.275765 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-faaa5423-a4ef-4aba-914a-48a3fa959ca6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:21.283636 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-faaa5423-a4ef-4aba-914a-48a3fa959ca6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.146673 Jul 25 08:47:21.284200 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 125/228] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:21 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:21.380295 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a349a786-5a00-4a23-b785-d7cd6d15a982 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:21.380925 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a349a786-5a00-4a23-b785-d7cd6d15a982 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:21.387712 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a349a786-5a00-4a23-b785-d7cd6d15a982 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:21.388684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a349a786-5a00-4a23-b785-d7cd6d15a982 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:21.389438 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a349a786-5a00-4a23-b785-d7cd6d15a982 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:21.389862 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a349a786-5a00-4a23-b785-d7cd6d15a982 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:21.565223 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a349a786-5a00-4a23-b785-d7cd6d15a982 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:21.575018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a349a786-5a00-4a23-b785-d7cd6d15a982 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.198479 Jul 25 08:47:21.576840 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 104/229] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:21 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:21.632196 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-92fb205e-49f9-41e1-822a-7a326b5c4147 req-d97aa9bd-4f7f-4136-a4c9-0ae6893c90ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed67f4fd-63db-4f9b-ab28-af9e82586d31", "name": "network-vif-plugged", "status": "completed", "tag": "af97c14f-36bb-413e-890c-ffc2a2e5b384"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:47:21.654270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-92fb205e-49f9-41e1-822a-7a326b5c4147 req-d97aa9bd-4f7f-4136-a4c9-0ae6893c90ac service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:21.655267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-92fb205e-49f9-41e1-822a-7a326b5c4147 req-d97aa9bd-4f7f-4136-a4c9-0ae6893c90ac service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:21.667439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-92fb205e-49f9-41e1-822a-7a326b5c4147 req-d97aa9bd-4f7f-4136-a4c9-0ae6893c90ac service nova] Creating event network-vif-plugged:af97c14f-36bb-413e-890c-ffc2a2e5b384 for instance ed67f4fd-63db-4f9b-ab28-af9e82586d31 on hv-cinder-85084 Jul 25 08:47:21.673874 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-92fb205e-49f9-41e1-822a-7a326b5c4147 req-d97aa9bd-4f7f-4136-a4c9-0ae6893c90ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045271 Jul 25 08:47:21.675371 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 126/230] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:47:22.304397 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3f856047-47c4-44f9-bcab-3cd8b1c9a749 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:22.305048 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3f856047-47c4-44f9-bcab-3cd8b1c9a749 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:22.311823 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f856047-47c4-44f9-bcab-3cd8b1c9a749 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:22.312274 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f856047-47c4-44f9-bcab-3cd8b1c9a749 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:22.313061 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f856047-47c4-44f9-bcab-3cd8b1c9a749 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:22.313494 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f856047-47c4-44f9-bcab-3cd8b1c9a749 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:22.439605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3f856047-47c4-44f9-bcab-3cd8b1c9a749 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:22.446913 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3f856047-47c4-44f9-bcab-3cd8b1c9a749 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.146327 Jul 25 08:47:22.447476 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 105/231] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:22 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:22.595991 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-03ae4267-d8ec-403c-9ec4-7d296893ecd6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:22.596708 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-03ae4267-d8ec-403c-9ec4-7d296893ecd6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:22.602799 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-03ae4267-d8ec-403c-9ec4-7d296893ecd6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:22.603247 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-03ae4267-d8ec-403c-9ec4-7d296893ecd6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:22.603998 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-03ae4267-d8ec-403c-9ec4-7d296893ecd6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:22.604436 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-03ae4267-d8ec-403c-9ec4-7d296893ecd6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:22.919216 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-03ae4267-d8ec-403c-9ec4-7d296893ecd6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:22.926439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-03ae4267-d8ec-403c-9ec4-7d296893ecd6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.335087 Jul 25 08:47:22.926996 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 127/232] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:22 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:23.467295 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c0c4d378-1d53-4d7f-8208-dfbe6e2dc3d7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:23.467848 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c0c4d378-1d53-4d7f-8208-dfbe6e2dc3d7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:23.474328 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c0c4d378-1d53-4d7f-8208-dfbe6e2dc3d7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:23.474776 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c0c4d378-1d53-4d7f-8208-dfbe6e2dc3d7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:23.475514 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c0c4d378-1d53-4d7f-8208-dfbe6e2dc3d7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:23.475944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c0c4d378-1d53-4d7f-8208-dfbe6e2dc3d7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:23.604657 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c0c4d378-1d53-4d7f-8208-dfbe6e2dc3d7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:23.612479 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c0c4d378-1d53-4d7f-8208-dfbe6e2dc3d7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.149073 Jul 25 08:47:23.613101 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 106/233] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:23 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:23.946948 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-54bfc2cc-83ba-4fa9-9a7a-5bcc913121e9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:23.947559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-54bfc2cc-83ba-4fa9-9a7a-5bcc913121e9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:23.954281 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54bfc2cc-83ba-4fa9-9a7a-5bcc913121e9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:23.954725 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54bfc2cc-83ba-4fa9-9a7a-5bcc913121e9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:23.955482 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54bfc2cc-83ba-4fa9-9a7a-5bcc913121e9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:23.955912 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54bfc2cc-83ba-4fa9-9a7a-5bcc913121e9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:24.080658 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-54bfc2cc-83ba-4fa9-9a7a-5bcc913121e9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:24.087943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-54bfc2cc-83ba-4fa9-9a7a-5bcc913121e9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.144797 Jul 25 08:47:24.088508 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 128/234] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:23 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:24.633392 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-73760247-ed01-4fd7-b542-5ab41e9c8fdd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:24.634253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-73760247-ed01-4fd7-b542-5ab41e9c8fdd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:24.641614 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-73760247-ed01-4fd7-b542-5ab41e9c8fdd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:24.642068 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-73760247-ed01-4fd7-b542-5ab41e9c8fdd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:24.642834 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-73760247-ed01-4fd7-b542-5ab41e9c8fdd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:24.643269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-73760247-ed01-4fd7-b542-5ab41e9c8fdd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:24.769390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-73760247-ed01-4fd7-b542-5ab41e9c8fdd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:24.776695 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-73760247-ed01-4fd7-b542-5ab41e9c8fdd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.147305 Jul 25 08:47:24.777256 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 107/235] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:24 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:25.109985 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-785f2b0f-9b57-46e4-85e3-5f07f7731649 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:25.110595 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-785f2b0f-9b57-46e4-85e3-5f07f7731649 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:25.116588 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-785f2b0f-9b57-46e4-85e3-5f07f7731649 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:25.117040 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-785f2b0f-9b57-46e4-85e3-5f07f7731649 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:25.117783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-785f2b0f-9b57-46e4-85e3-5f07f7731649 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:25.118208 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-785f2b0f-9b57-46e4-85e3-5f07f7731649 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:25.247319 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-785f2b0f-9b57-46e4-85e3-5f07f7731649 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:25.254771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-785f2b0f-9b57-46e4-85e3-5f07f7731649 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.149556 Jul 25 08:47:25.255337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 129/236] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:25 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:25.796915 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1fe797d5-235d-4676-96dd-635b642e1687 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:25.797586 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1fe797d5-235d-4676-96dd-635b642e1687 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:25.804054 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1fe797d5-235d-4676-96dd-635b642e1687 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:25.804504 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1fe797d5-235d-4676-96dd-635b642e1687 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:25.805299 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1fe797d5-235d-4676-96dd-635b642e1687 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:25.805733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1fe797d5-235d-4676-96dd-635b642e1687 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:25.930877 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1fe797d5-235d-4676-96dd-635b642e1687 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:25.938847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1fe797d5-235d-4676-96dd-635b642e1687 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.146206 Jul 25 08:47:25.939422 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 108/237] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:25 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:26.275140 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b951d7e0-502a-426e-baf9-4b61866eca2f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:26.275742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b951d7e0-502a-426e-baf9-4b61866eca2f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:26.282548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b951d7e0-502a-426e-baf9-4b61866eca2f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:26.282993 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b951d7e0-502a-426e-baf9-4b61866eca2f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:26.283736 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b951d7e0-502a-426e-baf9-4b61866eca2f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:26.284161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b951d7e0-502a-426e-baf9-4b61866eca2f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:26.410306 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b951d7e0-502a-426e-baf9-4b61866eca2f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:26.418481 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b951d7e0-502a-426e-baf9-4b61866eca2f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.147069 Jul 25 08:47:26.419044 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 130/238] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:26 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:26.959354 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-65ba8561-2fe0-43b0-8035-cc0dd63a6b32 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:26.959964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-65ba8561-2fe0-43b0-8035-cc0dd63a6b32 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:26.966453 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65ba8561-2fe0-43b0-8035-cc0dd63a6b32 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:26.966837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65ba8561-2fe0-43b0-8035-cc0dd63a6b32 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:26.967585 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65ba8561-2fe0-43b0-8035-cc0dd63a6b32 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:26.968512 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-65ba8561-2fe0-43b0-8035-cc0dd63a6b32 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:27.095283 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-65ba8561-2fe0-43b0-8035-cc0dd63a6b32 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:27.102639 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-65ba8561-2fe0-43b0-8035-cc0dd63a6b32 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.147062 Jul 25 08:47:27.103199 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 109/239] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:26 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:27.438990 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0ad23e07-9e9c-4f17-8e89-4404ff8f7f70 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:27.439622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0ad23e07-9e9c-4f17-8e89-4404ff8f7f70 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:27.445604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ad23e07-9e9c-4f17-8e89-4404ff8f7f70 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:27.446046 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ad23e07-9e9c-4f17-8e89-4404ff8f7f70 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:27.446792 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ad23e07-9e9c-4f17-8e89-4404ff8f7f70 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:27.447216 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ad23e07-9e9c-4f17-8e89-4404ff8f7f70 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:27.570715 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0ad23e07-9e9c-4f17-8e89-4404ff8f7f70 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:27.578395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0ad23e07-9e9c-4f17-8e89-4404ff8f7f70 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.143208 Jul 25 08:47:27.578957 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 131/240] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:27 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:28.124646 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e359abc8-6ef8-4f7c-9ee5-f4df9209afb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:28.125181 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e359abc8-6ef8-4f7c-9ee5-f4df9209afb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:28.131613 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e359abc8-6ef8-4f7c-9ee5-f4df9209afb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:28.132058 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e359abc8-6ef8-4f7c-9ee5-f4df9209afb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:28.132837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e359abc8-6ef8-4f7c-9ee5-f4df9209afb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:28.133275 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e359abc8-6ef8-4f7c-9ee5-f4df9209afb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:28.263397 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e359abc8-6ef8-4f7c-9ee5-f4df9209afb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:28.271245 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e359abc8-6ef8-4f7c-9ee5-f4df9209afb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.150689 Jul 25 08:47:28.271808 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 110/241] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:28 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:28.597511 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-09ff1ed9-537f-48fa-8340-33ef7a482bb0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:28.598153 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-09ff1ed9-537f-48fa-8340-33ef7a482bb0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:28.604125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-09ff1ed9-537f-48fa-8340-33ef7a482bb0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:28.604595 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-09ff1ed9-537f-48fa-8340-33ef7a482bb0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:28.605369 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-09ff1ed9-537f-48fa-8340-33ef7a482bb0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:28.605796 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-09ff1ed9-537f-48fa-8340-33ef7a482bb0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:28.733246 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-09ff1ed9-537f-48fa-8340-33ef7a482bb0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:28.741177 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-09ff1ed9-537f-48fa-8340-33ef7a482bb0 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.147406 Jul 25 08:47:28.741739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 132/242] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:28 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:29.292563 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b661fe48-bda0-43c1-8776-b6cc1fecb86e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:29.293202 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b661fe48-bda0-43c1-8776-b6cc1fecb86e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:29.300300 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b661fe48-bda0-43c1-8776-b6cc1fecb86e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:29.300782 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b661fe48-bda0-43c1-8776-b6cc1fecb86e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:29.301540 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b661fe48-bda0-43c1-8776-b6cc1fecb86e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:29.301969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b661fe48-bda0-43c1-8776-b6cc1fecb86e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:29.433485 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b661fe48-bda0-43c1-8776-b6cc1fecb86e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:29.441314 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b661fe48-bda0-43c1-8776-b6cc1fecb86e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.152624 Jul 25 08:47:29.442040 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 111/243] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:29 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:29.762226 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e3d95286-57f3-4111-91c2-81b3c46ecde6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:29.762837 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e3d95286-57f3-4111-91c2-81b3c46ecde6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:29.769351 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e3d95286-57f3-4111-91c2-81b3c46ecde6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:29.769806 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e3d95286-57f3-4111-91c2-81b3c46ecde6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:29.770552 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e3d95286-57f3-4111-91c2-81b3c46ecde6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:29.770983 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e3d95286-57f3-4111-91c2-81b3c46ecde6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:29.896156 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e3d95286-57f3-4111-91c2-81b3c46ecde6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:29.903614 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e3d95286-57f3-4111-91c2-81b3c46ecde6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.145385 Jul 25 08:47:29.904188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 133/244] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:29 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:30.461040 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e7093722-1a7e-40e2-b249-877e7e8eb813 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:30.461665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e7093722-1a7e-40e2-b249-877e7e8eb813 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:30.468802 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7093722-1a7e-40e2-b249-877e7e8eb813 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:30.469244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7093722-1a7e-40e2-b249-877e7e8eb813 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:30.469992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7093722-1a7e-40e2-b249-877e7e8eb813 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:30.470418 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7093722-1a7e-40e2-b249-877e7e8eb813 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:30.596321 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e7093722-1a7e-40e2-b249-877e7e8eb813 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:30.603681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e7093722-1a7e-40e2-b249-877e7e8eb813 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.146493 Jul 25 08:47:30.604259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 112/245] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:30 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:30.923673 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dee355d0-4218-4ca2-b06c-6c35dcc967bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:30.924278 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dee355d0-4218-4ca2-b06c-6c35dcc967bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:30.930354 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dee355d0-4218-4ca2-b06c-6c35dcc967bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:30.930797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dee355d0-4218-4ca2-b06c-6c35dcc967bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:30.931541 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dee355d0-4218-4ca2-b06c-6c35dcc967bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:30.931965 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dee355d0-4218-4ca2-b06c-6c35dcc967bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:31.064335 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dee355d0-4218-4ca2-b06c-6c35dcc967bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:31.071704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dee355d0-4218-4ca2-b06c-6c35dcc967bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.151868 Jul 25 08:47:31.072276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 134/246] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:30 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:31.622981 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b33e7763-b42c-427b-8ec6-c80025cc1d01 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:31.623591 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b33e7763-b42c-427b-8ec6-c80025cc1d01 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:31.630164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b33e7763-b42c-427b-8ec6-c80025cc1d01 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:31.630611 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b33e7763-b42c-427b-8ec6-c80025cc1d01 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:31.631365 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b33e7763-b42c-427b-8ec6-c80025cc1d01 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:31.631796 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b33e7763-b42c-427b-8ec6-c80025cc1d01 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:31.758786 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b33e7763-b42c-427b-8ec6-c80025cc1d01 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:31.767147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b33e7763-b42c-427b-8ec6-c80025cc1d01 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.147978 Jul 25 08:47:31.767711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 113/247] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:31 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:32.092124 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c11b64d3-c60b-4970-9f5f-c63efe0c856a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:32.092804 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c11b64d3-c60b-4970-9f5f-c63efe0c856a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:32.099348 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c11b64d3-c60b-4970-9f5f-c63efe0c856a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:32.099795 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c11b64d3-c60b-4970-9f5f-c63efe0c856a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:32.100544 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c11b64d3-c60b-4970-9f5f-c63efe0c856a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:32.101000 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c11b64d3-c60b-4970-9f5f-c63efe0c856a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:32.229774 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c11b64d3-c60b-4970-9f5f-c63efe0c856a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:32.237007 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c11b64d3-c60b-4970-9f5f-c63efe0c856a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.148626 Jul 25 08:47:32.237564 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 135/248] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:32 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:32.787253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c31f8dfa-aeee-442b-89df-4f2df7d18f1d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:32.787792 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c31f8dfa-aeee-442b-89df-4f2df7d18f1d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:32.794237 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c31f8dfa-aeee-442b-89df-4f2df7d18f1d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:32.794681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c31f8dfa-aeee-442b-89df-4f2df7d18f1d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:32.795424 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c31f8dfa-aeee-442b-89df-4f2df7d18f1d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:32.796358 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c31f8dfa-aeee-442b-89df-4f2df7d18f1d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:32.921576 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c31f8dfa-aeee-442b-89df-4f2df7d18f1d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:32.928833 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c31f8dfa-aeee-442b-89df-4f2df7d18f1d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.145360 Jul 25 08:47:32.929397 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 114/249] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:32 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:33.257589 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-621b02d9-ea50-4ce1-a9c4-11b99f81e1b1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:33.258198 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-621b02d9-ea50-4ce1-a9c4-11b99f81e1b1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:33.265041 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-621b02d9-ea50-4ce1-a9c4-11b99f81e1b1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:33.265490 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-621b02d9-ea50-4ce1-a9c4-11b99f81e1b1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:33.266243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-621b02d9-ea50-4ce1-a9c4-11b99f81e1b1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:33.266673 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-621b02d9-ea50-4ce1-a9c4-11b99f81e1b1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:33.391809 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-621b02d9-ea50-4ce1-a9c4-11b99f81e1b1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:33.397753 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:33.400397 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-621b02d9-ea50-4ce1-a9c4-11b99f81e1b1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1313 microversion: 2.1 time: 0.146573 Jul 25 08:47:33.401003 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 136/250] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:33 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:33.949402 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-43eb1ef7-5f07-4e80-9708-d81211aa365e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:33.950022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-43eb1ef7-5f07-4e80-9708-d81211aa365e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:33.957088 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-43eb1ef7-5f07-4e80-9708-d81211aa365e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:33.957536 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-43eb1ef7-5f07-4e80-9708-d81211aa365e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:33.958324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-43eb1ef7-5f07-4e80-9708-d81211aa365e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:33.958759 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-43eb1ef7-5f07-4e80-9708-d81211aa365e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:34.090505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-43eb1ef7-5f07-4e80-9708-d81211aa365e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:34.098190 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-43eb1ef7-5f07-4e80-9708-d81211aa365e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.152584 Jul 25 08:47:34.098866 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 115/251] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:33 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:34.421995 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-724f871c-b757-418d-9b1a-008dae42c2c5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:34.422600 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-724f871c-b757-418d-9b1a-008dae42c2c5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:34.429123 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-724f871c-b757-418d-9b1a-008dae42c2c5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:34.429589 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-724f871c-b757-418d-9b1a-008dae42c2c5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:34.430733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-724f871c-b757-418d-9b1a-008dae42c2c5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:34.431397 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-724f871c-b757-418d-9b1a-008dae42c2c5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:34.559559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-724f871c-b757-418d-9b1a-008dae42c2c5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:34.567152 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-724f871c-b757-418d-9b1a-008dae42c2c5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1497 microversion: 2.1 time: 0.149486 Jul 25 08:47:34.567797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 137/252] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:34 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:35.119750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f75ba7d3-f5d5-46a9-99aa-4e04e69a5642 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:35.120356 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f75ba7d3-f5d5-46a9-99aa-4e04e69a5642 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:35.127107 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f75ba7d3-f5d5-46a9-99aa-4e04e69a5642 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:35.127551 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f75ba7d3-f5d5-46a9-99aa-4e04e69a5642 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:35.128300 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f75ba7d3-f5d5-46a9-99aa-4e04e69a5642 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:35.128758 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f75ba7d3-f5d5-46a9-99aa-4e04e69a5642 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:35.261440 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f75ba7d3-f5d5-46a9-99aa-4e04e69a5642 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:35.269455 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f75ba7d3-f5d5-46a9-99aa-4e04e69a5642 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.153576 Jul 25 08:47:35.270021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 116/253] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:35 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:35.823777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5fbc3b0c-2c8e-4b2e-aed2-79a502749dcd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:35.824254 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5fbc3b0c-2c8e-4b2e-aed2-79a502749dcd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:35.830334 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5fbc3b0c-2c8e-4b2e-aed2-79a502749dcd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:35.830780 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5fbc3b0c-2c8e-4b2e-aed2-79a502749dcd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:35.831526 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5fbc3b0c-2c8e-4b2e-aed2-79a502749dcd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:35.831950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5fbc3b0c-2c8e-4b2e-aed2-79a502749dcd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:35.860026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5fbc3b0c-2c8e-4b2e-aed2-79a502749dcd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:47:35.951822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5fbc3b0c-2c8e-4b2e-aed2-79a502749dcd tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 204 len: 0 microversion: 2.1 time: 0.131476 Jul 25 08:47:35.952933 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 138/254] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:47:35 2022] DELETE /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:47:35.962332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-246ed76f-747c-4213-83a7-d1f229af29b6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:35.963415 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-246ed76f-747c-4213-83a7-d1f229af29b6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:35.970409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-246ed76f-747c-4213-83a7-d1f229af29b6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:35.970863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-246ed76f-747c-4213-83a7-d1f229af29b6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:35.971676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-246ed76f-747c-4213-83a7-d1f229af29b6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:35.972090 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-246ed76f-747c-4213-83a7-d1f229af29b6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:35.976995 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:36.120497 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-246ed76f-747c-4213-83a7-d1f229af29b6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:36.129388 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-246ed76f-747c-4213-83a7-d1f229af29b6 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.172343 Jul 25 08:47:36.129964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 117/255] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:35 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:36.290791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bffdd451-dba2-444d-8757-2d4afbdf79a9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:36.291514 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bffdd451-dba2-444d-8757-2d4afbdf79a9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:36.298124 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bffdd451-dba2-444d-8757-2d4afbdf79a9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:36.298623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bffdd451-dba2-444d-8757-2d4afbdf79a9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:36.299530 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bffdd451-dba2-444d-8757-2d4afbdf79a9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:36.300013 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bffdd451-dba2-444d-8757-2d4afbdf79a9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:36.428897 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bffdd451-dba2-444d-8757-2d4afbdf79a9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:36.436334 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bffdd451-dba2-444d-8757-2d4afbdf79a9 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.149786 Jul 25 08:47:36.436932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 139/256] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:36 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:37.151334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-045c7612-aed7-4d95-8c30-47a5b2384f01 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:37.152060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-045c7612-aed7-4d95-8c30-47a5b2384f01 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:37.159630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-045c7612-aed7-4d95-8c30-47a5b2384f01 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:37.160423 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-045c7612-aed7-4d95-8c30-47a5b2384f01 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:37.161017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-045c7612-aed7-4d95-8c30-47a5b2384f01 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:37.161527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-045c7612-aed7-4d95-8c30-47a5b2384f01 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:37.340699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-045c7612-aed7-4d95-8c30-47a5b2384f01 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:37.356161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-045c7612-aed7-4d95-8c30-47a5b2384f01 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.208690 Jul 25 08:47:37.360209 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 118/257] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:37 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:37.460848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-81fd028d-4eac-499f-96e8-4dc4fb59c8ea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:37.461486 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-81fd028d-4eac-499f-96e8-4dc4fb59c8ea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:37.473272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81fd028d-4eac-499f-96e8-4dc4fb59c8ea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:37.473724 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81fd028d-4eac-499f-96e8-4dc4fb59c8ea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:37.474580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81fd028d-4eac-499f-96e8-4dc4fb59c8ea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:37.474929 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81fd028d-4eac-499f-96e8-4dc4fb59c8ea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:37.611380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-81fd028d-4eac-499f-96e8-4dc4fb59c8ea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:37.619386 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-81fd028d-4eac-499f-96e8-4dc4fb59c8ea tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.166119 Jul 25 08:47:37.620045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 140/258] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:37 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:38.378506 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b5988e63-60e5-491e-abe7-037bc86f2328 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:38.379203 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b5988e63-60e5-491e-abe7-037bc86f2328 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:38.386785 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5988e63-60e5-491e-abe7-037bc86f2328 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:38.388964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5988e63-60e5-491e-abe7-037bc86f2328 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:38.390521 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5988e63-60e5-491e-abe7-037bc86f2328 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:38.391366 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5988e63-60e5-491e-abe7-037bc86f2328 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:38.543250 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b5988e63-60e5-491e-abe7-037bc86f2328 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:38.551279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b5988e63-60e5-491e-abe7-037bc86f2328 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.176670 Jul 25 08:47:38.551840 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 119/259] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:38 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:38.641164 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e45e2ea9-20ce-4134-9c23-931240a8ca39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:38.641778 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e45e2ea9-20ce-4134-9c23-931240a8ca39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:38.647866 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e45e2ea9-20ce-4134-9c23-931240a8ca39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:38.648317 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e45e2ea9-20ce-4134-9c23-931240a8ca39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:38.649183 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e45e2ea9-20ce-4134-9c23-931240a8ca39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:38.649623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e45e2ea9-20ce-4134-9c23-931240a8ca39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:38.778506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e45e2ea9-20ce-4134-9c23-931240a8ca39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:38.785880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e45e2ea9-20ce-4134-9c23-931240a8ca39 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.148561 Jul 25 08:47:38.786448 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 141/260] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:38 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:39.571863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3a590932-3d82-43fd-9b41-a035c8ee8e12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:39.572476 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3a590932-3d82-43fd-9b41-a035c8ee8e12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:39.579437 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3a590932-3d82-43fd-9b41-a035c8ee8e12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:39.579880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3a590932-3d82-43fd-9b41-a035c8ee8e12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:39.580665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3a590932-3d82-43fd-9b41-a035c8ee8e12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:39.581100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3a590932-3d82-43fd-9b41-a035c8ee8e12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:39.706394 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3a590932-3d82-43fd-9b41-a035c8ee8e12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:39.713779 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3a590932-3d82-43fd-9b41-a035c8ee8e12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.145713 Jul 25 08:47:39.714343 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 120/261] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:39 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:39.806910 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-773d10ac-e4ff-4f18-8743-2c32caf03108 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:39.807450 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-773d10ac-e4ff-4f18-8743-2c32caf03108 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:39.809506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:39.815170 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-773d10ac-e4ff-4f18-8743-2c32caf03108 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:39.815619 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-773d10ac-e4ff-4f18-8743-2c32caf03108 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:39.816375 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-773d10ac-e4ff-4f18-8743-2c32caf03108 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:39.816831 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-773d10ac-e4ff-4f18-8743-2c32caf03108 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:39.950899 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-773d10ac-e4ff-4f18-8743-2c32caf03108 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:39.958876 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-773d10ac-e4ff-4f18-8743-2c32caf03108 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.155871 Jul 25 08:47:39.959446 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 142/262] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:39 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:40.735222 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-429aba03-c662-4087-8e37-207756b2a284 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:40.735833 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-429aba03-c662-4087-8e37-207756b2a284 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:40.742404 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-429aba03-c662-4087-8e37-207756b2a284 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:40.742849 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-429aba03-c662-4087-8e37-207756b2a284 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:40.743605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-429aba03-c662-4087-8e37-207756b2a284 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:40.744040 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-429aba03-c662-4087-8e37-207756b2a284 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:40.870742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-429aba03-c662-4087-8e37-207756b2a284 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:40.878065 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-429aba03-c662-4087-8e37-207756b2a284 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.147225 Jul 25 08:47:40.878634 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 121/263] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:40 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:40.980414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-71c9a709-16c1-4e51-8eb4-e96ebe5ee01f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:40.981058 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-71c9a709-16c1-4e51-8eb4-e96ebe5ee01f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:40.987158 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-71c9a709-16c1-4e51-8eb4-e96ebe5ee01f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:40.987614 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-71c9a709-16c1-4e51-8eb4-e96ebe5ee01f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:40.988370 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-71c9a709-16c1-4e51-8eb4-e96ebe5ee01f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:40.988839 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-71c9a709-16c1-4e51-8eb4-e96ebe5ee01f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:41.115993 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-71c9a709-16c1-4e51-8eb4-e96ebe5ee01f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:41.123435 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-71c9a709-16c1-4e51-8eb4-e96ebe5ee01f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.146827 Jul 25 08:47:41.124492 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 143/264] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:40 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:41.899159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-91f553e5-2c42-43f6-bf58-c9193962ea12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:41.899801 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-91f553e5-2c42-43f6-bf58-c9193962ea12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:41.906727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-91f553e5-2c42-43f6-bf58-c9193962ea12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:41.907175 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-91f553e5-2c42-43f6-bf58-c9193962ea12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:41.907930 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-91f553e5-2c42-43f6-bf58-c9193962ea12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:41.908359 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-91f553e5-2c42-43f6-bf58-c9193962ea12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:42.036662 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-91f553e5-2c42-43f6-bf58-c9193962ea12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:42.044021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-91f553e5-2c42-43f6-bf58-c9193962ea12 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.148638 Jul 25 08:47:42.044656 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 122/265] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:41 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:42.144864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-90870c36-5c35-492e-87f2-4fd520574ece tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:42.145475 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-90870c36-5c35-492e-87f2-4fd520574ece tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:42.151568 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90870c36-5c35-492e-87f2-4fd520574ece tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:42.151968 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90870c36-5c35-492e-87f2-4fd520574ece tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:42.152761 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90870c36-5c35-492e-87f2-4fd520574ece tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:42.153199 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90870c36-5c35-492e-87f2-4fd520574ece tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:42.280773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-90870c36-5c35-492e-87f2-4fd520574ece tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:42.288242 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-90870c36-5c35-492e-87f2-4fd520574ece tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.147236 Jul 25 08:47:42.288848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 144/266] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:42 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:43.066338 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fab927fe-b25a-4135-b44d-11b465664ea9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:43.066953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fab927fe-b25a-4135-b44d-11b465664ea9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:43.073495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fab927fe-b25a-4135-b44d-11b465664ea9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:43.073944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fab927fe-b25a-4135-b44d-11b465664ea9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:43.074699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fab927fe-b25a-4135-b44d-11b465664ea9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:43.075129 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fab927fe-b25a-4135-b44d-11b465664ea9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:43.207236 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fab927fe-b25a-4135-b44d-11b465664ea9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:43.214675 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fab927fe-b25a-4135-b44d-11b465664ea9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.152254 Jul 25 08:47:43.215251 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 123/267] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:43 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:43.310402 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9d2d39a7-9911-44e6-9387-826221fc68b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:43.311041 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9d2d39a7-9911-44e6-9387-826221fc68b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:43.317630 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d2d39a7-9911-44e6-9387-826221fc68b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:43.318010 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d2d39a7-9911-44e6-9387-826221fc68b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:43.318783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d2d39a7-9911-44e6-9387-826221fc68b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:43.319236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d2d39a7-9911-44e6-9387-826221fc68b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:43.452429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9d2d39a7-9911-44e6-9387-826221fc68b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:43.459858 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9d2d39a7-9911-44e6-9387-826221fc68b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.154352 Jul 25 08:47:43.460435 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 145/268] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:43 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:44.235533 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2ffa8d64-298c-4b96-b896-09313adc26df tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:44.236140 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2ffa8d64-298c-4b96-b896-09313adc26df tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:44.238715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=45 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:44.243981 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ffa8d64-298c-4b96-b896-09313adc26df tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:44.244425 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ffa8d64-298c-4b96-b896-09313adc26df tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:44.245193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ffa8d64-298c-4b96-b896-09313adc26df tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:44.245620 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ffa8d64-298c-4b96-b896-09313adc26df tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:44.373059 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2ffa8d64-298c-4b96-b896-09313adc26df tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:44.380920 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2ffa8d64-298c-4b96-b896-09313adc26df tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.149488 Jul 25 08:47:44.381485 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 124/269] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:44 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:44.480955 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0b261ca4-7d19-46e3-8543-51ae3ebfbf3d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:44.481598 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0b261ca4-7d19-46e3-8543-51ae3ebfbf3d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:44.488145 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b261ca4-7d19-46e3-8543-51ae3ebfbf3d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:44.488607 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b261ca4-7d19-46e3-8543-51ae3ebfbf3d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:44.489366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b261ca4-7d19-46e3-8543-51ae3ebfbf3d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:44.489814 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b261ca4-7d19-46e3-8543-51ae3ebfbf3d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:44.630218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0b261ca4-7d19-46e3-8543-51ae3ebfbf3d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:44.638102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0b261ca4-7d19-46e3-8543-51ae3ebfbf3d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.160942 Jul 25 08:47:44.638682 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 146/270] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:44 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:45.402403 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6ea858d5-b788-40c4-b935-7e25908fb597 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:45.403012 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6ea858d5-b788-40c4-b935-7e25908fb597 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:45.410210 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6ea858d5-b788-40c4-b935-7e25908fb597 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:45.410657 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6ea858d5-b788-40c4-b935-7e25908fb597 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:45.411423 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6ea858d5-b788-40c4-b935-7e25908fb597 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:45.411852 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6ea858d5-b788-40c4-b935-7e25908fb597 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:45.540299 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-6ea858d5-b788-40c4-b935-7e25908fb597 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:45.548293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6ea858d5-b788-40c4-b935-7e25908fb597 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.149727 Jul 25 08:47:45.548894 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 125/271] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:45 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:45.659372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9b65d687-7a08-4e34-902c-801916fca69e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:45.659974 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9b65d687-7a08-4e34-902c-801916fca69e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:45.665947 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9b65d687-7a08-4e34-902c-801916fca69e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:45.666394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9b65d687-7a08-4e34-902c-801916fca69e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:45.667150 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9b65d687-7a08-4e34-902c-801916fca69e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:45.667583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9b65d687-7a08-4e34-902c-801916fca69e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:45.799580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9b65d687-7a08-4e34-902c-801916fca69e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:45.807008 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9b65d687-7a08-4e34-902c-801916fca69e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.151479 Jul 25 08:47:45.807567 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 147/272] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:45 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:46.569662 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8676b4c9-98bb-411e-a31d-625e495b4bb2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:46.570203 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-8676b4c9-98bb-411e-a31d-625e495b4bb2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:46.577218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8676b4c9-98bb-411e-a31d-625e495b4bb2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:46.577688 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8676b4c9-98bb-411e-a31d-625e495b4bb2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:46.578455 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8676b4c9-98bb-411e-a31d-625e495b4bb2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:46.578883 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8676b4c9-98bb-411e-a31d-625e495b4bb2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:46.704035 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8676b4c9-98bb-411e-a31d-625e495b4bb2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:46.711323 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8676b4c9-98bb-411e-a31d-625e495b4bb2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.145598 Jul 25 08:47:46.711886 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 126/273] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:46 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:46.827535 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-77c88c1e-4871-43b5-a1c6-f62f0ad00756 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:46.828050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-77c88c1e-4871-43b5-a1c6-f62f0ad00756 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:46.834017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77c88c1e-4871-43b5-a1c6-f62f0ad00756 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:46.834451 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77c88c1e-4871-43b5-a1c6-f62f0ad00756 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:46.835201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77c88c1e-4871-43b5-a1c6-f62f0ad00756 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:46.835630 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77c88c1e-4871-43b5-a1c6-f62f0ad00756 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:46.963513 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-77c88c1e-4871-43b5-a1c6-f62f0ad00756 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:46.971613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-77c88c1e-4871-43b5-a1c6-f62f0ad00756 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.148402 Jul 25 08:47:46.972167 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 148/274] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:46 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:47.732238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-947d4cf6-4aba-4d3c-8142-4e5900044dc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:47.732910 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-947d4cf6-4aba-4d3c-8142-4e5900044dc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:47.739647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-947d4cf6-4aba-4d3c-8142-4e5900044dc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:47.740086 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-947d4cf6-4aba-4d3c-8142-4e5900044dc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:47.740876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-947d4cf6-4aba-4d3c-8142-4e5900044dc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:47.741309 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-947d4cf6-4aba-4d3c-8142-4e5900044dc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:47.868586 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-947d4cf6-4aba-4d3c-8142-4e5900044dc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:47.876476 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-947d4cf6-4aba-4d3c-8142-4e5900044dc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.148056 Jul 25 08:47:47.877080 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 127/275] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:47 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:47.994914 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2206875c-3fb7-4dd4-b8c7-522199b13d26 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:47.995468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2206875c-3fb7-4dd4-b8c7-522199b13d26 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:48.001788 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2206875c-3fb7-4dd4-b8c7-522199b13d26 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:48.002233 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2206875c-3fb7-4dd4-b8c7-522199b13d26 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:48.002994 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2206875c-3fb7-4dd4-b8c7-522199b13d26 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:48.003431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2206875c-3fb7-4dd4-b8c7-522199b13d26 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:48.129398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2206875c-3fb7-4dd4-b8c7-522199b13d26 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:48.137013 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2206875c-3fb7-4dd4-b8c7-522199b13d26 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.145890 Jul 25 08:47:48.137571 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 149/276] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:47 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:48.898198 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2e22eab7-8686-44ec-90cc-26987ea2b064 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:48.898811 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2e22eab7-8686-44ec-90cc-26987ea2b064 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:48.905283 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2e22eab7-8686-44ec-90cc-26987ea2b064 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:48.905730 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2e22eab7-8686-44ec-90cc-26987ea2b064 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:48.906491 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2e22eab7-8686-44ec-90cc-26987ea2b064 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:48.906925 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2e22eab7-8686-44ec-90cc-26987ea2b064 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:49.037658 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2e22eab7-8686-44ec-90cc-26987ea2b064 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:49.045133 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2e22eab7-8686-44ec-90cc-26987ea2b064 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.150796 Jul 25 08:47:49.046180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 128/277] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:48 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:49.157382 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1b833f04-0361-4883-86cc-12c092bc60bc tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:49.158321 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1b833f04-0361-4883-86cc-12c092bc60bc tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:49.164859 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b833f04-0361-4883-86cc-12c092bc60bc tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:49.165307 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b833f04-0361-4883-86cc-12c092bc60bc tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:49.166063 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b833f04-0361-4883-86cc-12c092bc60bc tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:49.166493 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b833f04-0361-4883-86cc-12c092bc60bc tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:49.291287 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1b833f04-0361-4883-86cc-12c092bc60bc tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:49.299028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1b833f04-0361-4883-86cc-12c092bc60bc tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.145432 Jul 25 08:47:49.299595 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 150/278] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:49 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:50.066715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e7e693b1-4220-4694-b49b-84ce5fa0ffa8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:50.067274 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e7e693b1-4220-4694-b49b-84ce5fa0ffa8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:50.073710 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7e693b1-4220-4694-b49b-84ce5fa0ffa8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:50.074151 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7e693b1-4220-4694-b49b-84ce5fa0ffa8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:50.074910 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7e693b1-4220-4694-b49b-84ce5fa0ffa8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:50.075339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7e693b1-4220-4694-b49b-84ce5fa0ffa8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:50.202090 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e7e693b1-4220-4694-b49b-84ce5fa0ffa8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:50.210132 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e7e693b1-4220-4694-b49b-84ce5fa0ffa8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.147331 Jul 25 08:47:50.210692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 129/279] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:50 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:50.320040 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9905d554-0403-4979-a05d-b7c02bf38ce0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:50.320597 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9905d554-0403-4979-a05d-b7c02bf38ce0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:50.326612 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9905d554-0403-4979-a05d-b7c02bf38ce0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:50.327059 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9905d554-0403-4979-a05d-b7c02bf38ce0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:50.328440 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9905d554-0403-4979-a05d-b7c02bf38ce0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:50.328894 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9905d554-0403-4979-a05d-b7c02bf38ce0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:50.454285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9905d554-0403-4979-a05d-b7c02bf38ce0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:50.456459 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:50.463395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9905d554-0403-4979-a05d-b7c02bf38ce0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.147214 Jul 25 08:47:50.463947 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 151/280] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:50 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:51.229892 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-133d5566-0685-4afc-bb2f-281ce6b24a99 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:51.230500 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-133d5566-0685-4afc-bb2f-281ce6b24a99 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:51.237032 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-133d5566-0685-4afc-bb2f-281ce6b24a99 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:51.237475 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-133d5566-0685-4afc-bb2f-281ce6b24a99 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:51.238227 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-133d5566-0685-4afc-bb2f-281ce6b24a99 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:51.238652 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-133d5566-0685-4afc-bb2f-281ce6b24a99 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:51.371889 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-133d5566-0685-4afc-bb2f-281ce6b24a99 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:51.380565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-133d5566-0685-4afc-bb2f-281ce6b24a99 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.154402 Jul 25 08:47:51.390808 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 130/281] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:51 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:51.484094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9d8e2ee9-2de6-484b-8545-80681cbcfee1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:51.484725 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9d8e2ee9-2de6-484b-8545-80681cbcfee1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:51.491503 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d8e2ee9-2de6-484b-8545-80681cbcfee1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:51.491946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d8e2ee9-2de6-484b-8545-80681cbcfee1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:51.492725 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d8e2ee9-2de6-484b-8545-80681cbcfee1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:51.493155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d8e2ee9-2de6-484b-8545-80681cbcfee1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:51.623285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9d8e2ee9-2de6-484b-8545-80681cbcfee1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:51.631231 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9d8e2ee9-2de6-484b-8545-80681cbcfee1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.151320 Jul 25 08:47:51.631784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 152/282] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:51 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:52.402338 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-88ccebbc-f9f2-4b5c-a1a2-3f87f5b1273a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:52.402975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-88ccebbc-f9f2-4b5c-a1a2-3f87f5b1273a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:52.409930 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-88ccebbc-f9f2-4b5c-a1a2-3f87f5b1273a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:52.410368 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-88ccebbc-f9f2-4b5c-a1a2-3f87f5b1273a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:52.411116 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-88ccebbc-f9f2-4b5c-a1a2-3f87f5b1273a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:52.411539 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-88ccebbc-f9f2-4b5c-a1a2-3f87f5b1273a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:52.538237 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-88ccebbc-f9f2-4b5c-a1a2-3f87f5b1273a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:52.545604 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-88ccebbc-f9f2-4b5c-a1a2-3f87f5b1273a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.147101 Jul 25 08:47:52.546811 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 131/283] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:52 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:52.652566 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5a890be1-37b9-4593-be25-a2b4ea6cb072 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:52.653110 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5a890be1-37b9-4593-be25-a2b4ea6cb072 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:52.659911 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5a890be1-37b9-4593-be25-a2b4ea6cb072 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:52.660385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5a890be1-37b9-4593-be25-a2b4ea6cb072 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:52.661201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5a890be1-37b9-4593-be25-a2b4ea6cb072 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:52.661638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5a890be1-37b9-4593-be25-a2b4ea6cb072 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:52.922853 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5a890be1-37b9-4593-be25-a2b4ea6cb072 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:52.930146 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5a890be1-37b9-4593-be25-a2b4ea6cb072 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.281416 Jul 25 08:47:52.930694 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 153/284] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:52 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:53.567253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-63051d6c-49ac-4b88-83ea-aac9e295e3a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:53.567767 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-63051d6c-49ac-4b88-83ea-aac9e295e3a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:53.574240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-63051d6c-49ac-4b88-83ea-aac9e295e3a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:53.574684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-63051d6c-49ac-4b88-83ea-aac9e295e3a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:53.575432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-63051d6c-49ac-4b88-83ea-aac9e295e3a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:53.575856 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-63051d6c-49ac-4b88-83ea-aac9e295e3a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:53.700956 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-63051d6c-49ac-4b88-83ea-aac9e295e3a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:53.708538 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-63051d6c-49ac-4b88-83ea-aac9e295e3a1 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.145162 Jul 25 08:47:53.709129 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 132/285] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:53 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:53.950292 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ca57638f-6256-4087-ac86-e3630d05529d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:53.950893 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ca57638f-6256-4087-ac86-e3630d05529d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:53.956797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ca57638f-6256-4087-ac86-e3630d05529d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:53.957240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ca57638f-6256-4087-ac86-e3630d05529d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:53.957982 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ca57638f-6256-4087-ac86-e3630d05529d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:53.958411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ca57638f-6256-4087-ac86-e3630d05529d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:54.087507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ca57638f-6256-4087-ac86-e3630d05529d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:54.095270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ca57638f-6256-4087-ac86-e3630d05529d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.148749 Jul 25 08:47:54.095823 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 154/286] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:53 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:54.729947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dcf2fd8c-8eb7-4b4a-9e0c-64c0a5d23dac tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:54.731044 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dcf2fd8c-8eb7-4b4a-9e0c-64c0a5d23dac tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:54.737367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcf2fd8c-8eb7-4b4a-9e0c-64c0a5d23dac tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:54.737698 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcf2fd8c-8eb7-4b4a-9e0c-64c0a5d23dac tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:54.738466 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcf2fd8c-8eb7-4b4a-9e0c-64c0a5d23dac tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:54.738900 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcf2fd8c-8eb7-4b4a-9e0c-64c0a5d23dac tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:54.863506 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dcf2fd8c-8eb7-4b4a-9e0c-64c0a5d23dac tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:54.867054 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=100 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:47:54.871753 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dcf2fd8c-8eb7-4b4a-9e0c-64c0a5d23dac tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.147137 Jul 25 08:47:54.872269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 133/287] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:54 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:55.115671 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0b075ac2-42e4-4419-a0cc-1ec7df7bf8a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:55.116333 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0b075ac2-42e4-4419-a0cc-1ec7df7bf8a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:55.122409 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b075ac2-42e4-4419-a0cc-1ec7df7bf8a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:55.122855 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b075ac2-42e4-4419-a0cc-1ec7df7bf8a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:55.123611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b075ac2-42e4-4419-a0cc-1ec7df7bf8a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:55.124045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b075ac2-42e4-4419-a0cc-1ec7df7bf8a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:55.248155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0b075ac2-42e4-4419-a0cc-1ec7df7bf8a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:55.256143 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0b075ac2-42e4-4419-a0cc-1ec7df7bf8a1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.144349 Jul 25 08:47:55.256724 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 155/288] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:55 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:55.893454 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-01dd3e30-f38f-4794-9a2b-c20779a0ecc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:55.894061 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-01dd3e30-f38f-4794-9a2b-c20779a0ecc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:55.900584 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-01dd3e30-f38f-4794-9a2b-c20779a0ecc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:55.901038 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-01dd3e30-f38f-4794-9a2b-c20779a0ecc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:55.901787 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-01dd3e30-f38f-4794-9a2b-c20779a0ecc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:55.902218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-01dd3e30-f38f-4794-9a2b-c20779a0ecc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:56.035175 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-01dd3e30-f38f-4794-9a2b-c20779a0ecc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:56.042574 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-01dd3e30-f38f-4794-9a2b-c20779a0ecc5 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.153383 Jul 25 08:47:56.043080 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 134/289] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:55 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:56.121562 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-5c2695d0-8641-41f4-a9b7-22fb037a5d23 req-4b67cefb-c0ba-47d1-9cdd-68e3f0525085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed67f4fd-63db-4f9b-ab28-af9e82586d31", "name": "network-vif-unplugged", "status": "completed", "tag": "af97c14f-36bb-413e-890c-ffc2a2e5b384"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:47:56.131984 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-5c2695d0-8641-41f4-a9b7-22fb037a5d23 req-4b67cefb-c0ba-47d1-9cdd-68e3f0525085 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:56.132650 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-5c2695d0-8641-41f4-a9b7-22fb037a5d23 req-4b67cefb-c0ba-47d1-9cdd-68e3f0525085 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:56.152262 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-5c2695d0-8641-41f4-a9b7-22fb037a5d23 req-4b67cefb-c0ba-47d1-9cdd-68e3f0525085 service nova] Creating event network-vif-unplugged:af97c14f-36bb-413e-890c-ffc2a2e5b384 for instance ed67f4fd-63db-4f9b-ab28-af9e82586d31 on hv-cinder-85084 Jul 25 08:47:56.160058 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-5c2695d0-8641-41f4-a9b7-22fb037a5d23 req-4b67cefb-c0ba-47d1-9cdd-68e3f0525085 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042662 Jul 25 08:47:56.160762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 156/290] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:47:56.276788 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-678d396b-c698-4068-b100-ecafa5addeb3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:56.277405 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-678d396b-c698-4068-b100-ecafa5addeb3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:56.283357 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-678d396b-c698-4068-b100-ecafa5addeb3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:56.283804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-678d396b-c698-4068-b100-ecafa5addeb3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:56.284558 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-678d396b-c698-4068-b100-ecafa5addeb3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:56.285011 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-678d396b-c698-4068-b100-ecafa5addeb3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:56.408133 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-678d396b-c698-4068-b100-ecafa5addeb3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:56.415552 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-678d396b-c698-4068-b100-ecafa5addeb3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1522 microversion: 2.1 time: 0.142627 Jul 25 08:47:56.416113 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 135/291] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:56 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:57.065297 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6af25cf5-1443-40a4-bb1a-a55954e0127d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:57.066585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6af25cf5-1443-40a4-bb1a-a55954e0127d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:57.073646 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6af25cf5-1443-40a4-bb1a-a55954e0127d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:57.074448 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6af25cf5-1443-40a4-bb1a-a55954e0127d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:57.075559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6af25cf5-1443-40a4-bb1a-a55954e0127d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:57.076186 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6af25cf5-1443-40a4-bb1a-a55954e0127d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:57.242505 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6af25cf5-1443-40a4-bb1a-a55954e0127d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:57.251450 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6af25cf5-1443-40a4-bb1a-a55954e0127d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1503 microversion: 2.1 time: 0.190829 Jul 25 08:47:57.253129 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 157/292] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:57 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:57.437194 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ab467af4-fe64-4a29-8103-5867ef099aec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:57.438206 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ab467af4-fe64-4a29-8103-5867ef099aec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:57.446544 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ab467af4-fe64-4a29-8103-5867ef099aec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:57.447215 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ab467af4-fe64-4a29-8103-5867ef099aec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:57.448178 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ab467af4-fe64-4a29-8103-5867ef099aec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:57.448993 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ab467af4-fe64-4a29-8103-5867ef099aec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:57.679859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ab467af4-fe64-4a29-8103-5867ef099aec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:57.688948 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ab467af4-fe64-4a29-8103-5867ef099aec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1502 microversion: 2.1 time: 0.256576 Jul 25 08:47:57.689599 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 136/293] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:57 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:57.693054 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-c3b8d83e-e4ff-44ee-bb40-f61863c6be56 req-b3468a20-7368-43bc-80fe-c2fa5d744428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed67f4fd-63db-4f9b-ab28-af9e82586d31", "name": "network-vif-deleted", "tag": "af97c14f-36bb-413e-890c-ffc2a2e5b384"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:47:57.705751 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c3b8d83e-e4ff-44ee-bb40-f61863c6be56 req-b3468a20-7368-43bc-80fe-c2fa5d744428 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:57.706526 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c3b8d83e-e4ff-44ee-bb40-f61863c6be56 req-b3468a20-7368-43bc-80fe-c2fa5d744428 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:57.715533 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2a49b2b7-0636-426f-aaa9-0d0830dcb23e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:57.716309 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2a49b2b7-0636-426f-aaa9-0d0830dcb23e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:57.719627 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-c3b8d83e-e4ff-44ee-bb40-f61863c6be56 req-b3468a20-7368-43bc-80fe-c2fa5d744428 service nova] Creating event network-vif-deleted:af97c14f-36bb-413e-890c-ffc2a2e5b384 for instance ed67f4fd-63db-4f9b-ab28-af9e82586d31 on hv-cinder-85084 Jul 25 08:47:57.725111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2a49b2b7-0636-426f-aaa9-0d0830dcb23e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:57.725692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2a49b2b7-0636-426f-aaa9-0d0830dcb23e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:57.726544 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2a49b2b7-0636-426f-aaa9-0d0830dcb23e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:57.726666 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-c3b8d83e-e4ff-44ee-bb40-f61863c6be56 req-b3468a20-7368-43bc-80fe-c2fa5d744428 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040579 Jul 25 08:47:57.727112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2a49b2b7-0636-426f-aaa9-0d0830dcb23e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:57.728056 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 158/294] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:47:57.912810 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2a49b2b7-0636-426f-aaa9-0d0830dcb23e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:57.929293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2a49b2b7-0636-426f-aaa9-0d0830dcb23e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1516 microversion: 2.1 time: 0.220002 Jul 25 08:47:57.931734 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 137/295] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:57 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:58.274831 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:58.275542 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:58.286737 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:58.287425 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:58.289122 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:58.290149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:58.385276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:58.385756 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:58.386195 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lazy-loading 'fault' on Instance uuid ed67f4fd-63db-4f9b-ab28-af9e82586d31 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:47:58.470524 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:58.479226 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7c658c89-1bc4-43c8-908b-252992380933 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 200 len: 1303 microversion: 2.1 time: 0.209228 Jul 25 08:47:58.480867 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 159/296] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:58 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:47:59.162977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-54ccf12f-78a2-4ffc-b427-32ec48fa002a tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:59.163828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-54ccf12f-78a2-4ffc-b427-32ec48fa002a tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:59.170232 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54ccf12f-78a2-4ffc-b427-32ec48fa002a tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:59.170664 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54ccf12f-78a2-4ffc-b427-32ec48fa002a tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:59.172636 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54ccf12f-78a2-4ffc-b427-32ec48fa002a tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:59.173098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54ccf12f-78a2-4ffc-b427-32ec48fa002a tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:59.200632 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-54ccf12f-78a2-4ffc-b427-32ec48fa002a tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:47:59.437175 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-54ccf12f-78a2-4ffc-b427-32ec48fa002a tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 204 len: 0 microversion: 2.1 time: 0.277904 Jul 25 08:47:59.437745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 138/297] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:47:59 2022] DELETE /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:47:59.445689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3cd2ce42-bc82-4a7e-97cf-60d2492841da tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:59.446299 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3cd2ce42-bc82-4a7e-97cf-60d2492841da tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:59.461039 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cd2ce42-bc82-4a7e-97cf-60d2492841da tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:59.461715 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cd2ce42-bc82-4a7e-97cf-60d2492841da tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:59.462677 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cd2ce42-bc82-4a7e-97cf-60d2492841da tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:59.463302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cd2ce42-bc82-4a7e-97cf-60d2492841da tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:59.501807 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3578a08c-3ff4-4378-8cdf-6f58defb3b8d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:47:59.502783 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3578a08c-3ff4-4378-8cdf-6f58defb3b8d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: ed67f4fd-63db-4f9b-ab28-af9e82586d31] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:47:59.509699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3578a08c-3ff4-4378-8cdf-6f58defb3b8d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:59.510146 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3578a08c-3ff4-4378-8cdf-6f58defb3b8d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:59.510909 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3578a08c-3ff4-4378-8cdf-6f58defb3b8d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:47:59.511341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3578a08c-3ff4-4378-8cdf-6f58defb3b8d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:47:59.525197 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-3578a08c-3ff4-4378-8cdf-6f58defb3b8d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] HTTP exception thrown: Instance ed67f4fd-63db-4f9b-ab28-af9e82586d31 could not be found. Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3578a08c-3ff4-4378-8cdf-6f58defb3b8d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Request method failure captured: Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 HTTP/1.1 Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lh2lb8SpVqNK2uS0WG5DSNKNCfP_wtRlhbSyH8-81Oi77p_-7981C4BsPi_bBweytoiqWOk-SvxFUNO7pX57wwSQwWj6D0byc7HUZ8BcsyToVTVHKwPM52vILBx7NMXktcncvE3TFQYaG_wD_W0qFjY5oK9_7Jcag3X_fknMstp7So Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: d358c71209624c55b7db08cc3435dbcb Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-VolumesActionsTest-1341318003 Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:47:59.530069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d358c71209624c55b7db08cc3435dbcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d358c71209624c55b7db08cc3435dbcb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d358c71209624c55b7db08cc3435dbcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d358c71209624c55b7db08cc3435dbcb"}]}] Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-VolumesActionsTest-1341318003 Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: d358c71209624c55b7db08cc3435dbcb Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-VolumesActionsTest-1341318003 Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-VolumesActionsTest-1341318003-project Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: bf0c0131372345e6b23260b466ec8ff9 Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-VolumesActionsTest-1341318003-project Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance ed67f4fd-63db-4f9b-ab28-af9e82586d31 could not be found. Jul 25 08:47:59.532184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'ed67f4fd-63db-4f9b-ab28-af9e82586d31'} Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed67f4fd-63db-4f9b-ab28-af9e82586d31 could not be found. Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:47:59.533257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed67f4fd-63db-4f9b-ab28-af9e82586d31 could not be found. Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed67f4fd-63db-4f9b-ab28-af9e82586d31 could not be found. Jul 25 08:47:59.534714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:47:59.535809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3578a08c-3ff4-4378-8cdf-6f58defb3b8d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Returning 404 to user: Instance ed67f4fd-63db-4f9b-ab28-af9e82586d31 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:47:59.535809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3578a08c-3ff4-4378-8cdf-6f58defb3b8d tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31" status: 404 len: 111 microversion: 2.1 time: 0.034491 Jul 25 08:47:59.535809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 139/298] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:59 2022] GET /compute/v2.1/servers/ed67f4fd-63db-4f9b-ab28-af9e82586d31 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 08:47:59.601453 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3cd2ce42-bc82-4a7e-97cf-60d2492841da tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:47:59.609788 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3cd2ce42-bc82-4a7e-97cf-60d2492841da tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1552 microversion: 2.1 time: 0.167817 Jul 25 08:47:59.610280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 160/299] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:47:59 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:47:59.653365 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-943043988", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "networks": [{"uuid": "df2c555e-a7b1-4886-b8d4-ee1799973637"}]}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:47:59.706131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.network.neutron [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] validate_networks() for [('df2c555e-a7b1-4886-b8d4-ee1799973637', None, None, None, None, None)] {{(pid=124234) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:48:00.055944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Flavor limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:48:00.056375 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Image limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:48:00.057218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Flavor pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:48:00.057644 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Image pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:48:00.058058 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:48:00.067472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:00.067923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:00.068765 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:00.069205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:00.086773 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Getting quotas for project d358c71209624c55b7db08cc3435dbcb. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:48:00.090720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Getting quotas for user bf0c0131372345e6b23260b466ec8ff9 and project d358c71209624c55b7db08cc3435dbcb. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:48:00.101390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Going to run 1 instances... {{(pid=124234) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:48:00.103585 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124234) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:48:00.151506 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-70f772ba-8f6b-443e-ada4-8824f2c3ee78 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502121 Jul 25 08:48:00.152145 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 140/300] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:47:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:48:00.162707 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f14fba9e-5ad4-4f4d-a7b9-46a95bde165e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:00.163313 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f14fba9e-5ad4-4f4d-a7b9-46a95bde165e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:00.220284 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f14fba9e-5ad4-4f4d-a7b9-46a95bde165e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:00.227260 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f14fba9e-5ad4-4f4d-a7b9-46a95bde165e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1213 microversion: 2.1 time: 0.068297 Jul 25 08:48:00.227899 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 161/301] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:00 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:00.506764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-49bdd355-3276-4e1d-840a-8955d76218bb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:00.509718 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-49bdd355-3276-4e1d-840a-8955d76218bb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:00.516190 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49bdd355-3276-4e1d-840a-8955d76218bb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:00.516678 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49bdd355-3276-4e1d-840a-8955d76218bb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:00.517450 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49bdd355-3276-4e1d-840a-8955d76218bb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:00.517897 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49bdd355-3276-4e1d-840a-8955d76218bb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:00.541087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.objects.instance [None req-49bdd355-3276-4e1d-840a-8955d76218bb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lazy-loading 'flavor' on Instance uuid 22b16067-f13e-472e-a335-bbb66b7461b1 {{(pid=124234) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:48:00.630033 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8ec0925c-06a9-4e86-9fc6-00132139d6ec tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:00.631287 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8ec0925c-06a9-4e86-9fc6-00132139d6ec tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:00.637657 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8ec0925c-06a9-4e86-9fc6-00132139d6ec tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:00.638109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8ec0925c-06a9-4e86-9fc6-00132139d6ec tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:00.638869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8ec0925c-06a9-4e86-9fc6-00132139d6ec tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:00.639303 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8ec0925c-06a9-4e86-9fc6-00132139d6ec tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:00.649210 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-49bdd355-3276-4e1d-840a-8955d76218bb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1/action" status: 200 len: 32 microversion: 2.1 time: 0.147310 Jul 25 08:48:00.649803 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 141/302] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:48:00 2022] POST /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:48:00.659963 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b25f3537-5e67-41dd-bcfc-fa4fe7698b52 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:00.660675 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b25f3537-5e67-41dd-bcfc-fa4fe7698b52 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:00.666716 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b25f3537-5e67-41dd-bcfc-fa4fe7698b52 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:00.667169 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b25f3537-5e67-41dd-bcfc-fa4fe7698b52 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:00.667936 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b25f3537-5e67-41dd-bcfc-fa4fe7698b52 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:00.668375 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b25f3537-5e67-41dd-bcfc-fa4fe7698b52 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:00.833420 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8ec0925c-06a9-4e86-9fc6-00132139d6ec tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:00.840799 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b25f3537-5e67-41dd-bcfc-fa4fe7698b52 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:00.841292 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8ec0925c-06a9-4e86-9fc6-00132139d6ec tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1552 microversion: 2.1 time: 0.215127 Jul 25 08:48:00.841860 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 162/303] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:00 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1552 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:00.848832 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b25f3537-5e67-41dd-bcfc-fa4fe7698b52 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.193315 Jul 25 08:48:00.849447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 142/304] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:00 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:01.248197 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-53aa4da7-949f-4284-9387-2a7e21113b5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:01.248836 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-53aa4da7-949f-4284-9387-2a7e21113b5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:01.255385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53aa4da7-949f-4284-9387-2a7e21113b5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:01.255835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53aa4da7-949f-4284-9387-2a7e21113b5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:01.256609 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53aa4da7-949f-4284-9387-2a7e21113b5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:01.257048 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53aa4da7-949f-4284-9387-2a7e21113b5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:01.319880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-53aa4da7-949f-4284-9387-2a7e21113b5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:01.327327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-53aa4da7-949f-4284-9387-2a7e21113b5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1217 microversion: 2.1 time: 0.082988 Jul 25 08:48:01.327877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 163/305] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:01 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:01.862318 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-34545d29-db43-4f49-9624-a161879a5041 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:01.862926 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-34545d29-db43-4f49-9624-a161879a5041 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:01.869507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bf2afe70-ec40-4ed8-af0c-9242e723551c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:01.869957 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-34545d29-db43-4f49-9624-a161879a5041 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:01.870124 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bf2afe70-ec40-4ed8-af0c-9242e723551c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:01.870271 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-34545d29-db43-4f49-9624-a161879a5041 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:01.871013 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-34545d29-db43-4f49-9624-a161879a5041 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:01.871443 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-34545d29-db43-4f49-9624-a161879a5041 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:01.876123 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf2afe70-ec40-4ed8-af0c-9242e723551c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:01.876585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf2afe70-ec40-4ed8-af0c-9242e723551c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:01.877361 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf2afe70-ec40-4ed8-af0c-9242e723551c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:01.877794 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf2afe70-ec40-4ed8-af0c-9242e723551c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:02.249766 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-34545d29-db43-4f49-9624-a161879a5041 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:02.253059 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bf2afe70-ec40-4ed8-af0c-9242e723551c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:02.257982 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-34545d29-db43-4f49-9624-a161879a5041 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1552 microversion: 2.1 time: 0.399425 Jul 25 08:48:02.258982 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 143/306] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:01 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1552 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:02.261560 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bf2afe70-ec40-4ed8-af0c-9242e723551c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.395791 Jul 25 08:48:02.262151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 164/307] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:01 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:02.347025 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-14055bfd-170e-42af-a25e-d1793ec4af35 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:02.347630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-14055bfd-170e-42af-a25e-d1793ec4af35 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:02.353536 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-14055bfd-170e-42af-a25e-d1793ec4af35 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:02.353979 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-14055bfd-170e-42af-a25e-d1793ec4af35 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:02.354724 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-14055bfd-170e-42af-a25e-d1793ec4af35 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:02.355154 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-14055bfd-170e-42af-a25e-d1793ec4af35 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:02.413788 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-14055bfd-170e-42af-a25e-d1793ec4af35 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:02.421135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-14055bfd-170e-42af-a25e-d1793ec4af35 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1217 microversion: 2.1 time: 0.077717 Jul 25 08:48:02.421691 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 144/308] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:02 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:03.279793 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2ba72885-2a58-4a06-902f-b235e1a40f06 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:03.281032 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2ba72885-2a58-4a06-902f-b235e1a40f06 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:03.283011 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-68297421-c49a-4b45-b8ae-990f6a4fa29b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:03.283646 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-68297421-c49a-4b45-b8ae-990f6a4fa29b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:03.287119 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ba72885-2a58-4a06-902f-b235e1a40f06 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:03.287573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ba72885-2a58-4a06-902f-b235e1a40f06 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:03.288452 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ba72885-2a58-4a06-902f-b235e1a40f06 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:03.288834 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ba72885-2a58-4a06-902f-b235e1a40f06 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:03.289910 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-68297421-c49a-4b45-b8ae-990f6a4fa29b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:03.290383 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-68297421-c49a-4b45-b8ae-990f6a4fa29b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:03.291168 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-68297421-c49a-4b45-b8ae-990f6a4fa29b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:03.291565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-68297421-c49a-4b45-b8ae-990f6a4fa29b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:03.484128 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2ba72885-2a58-4a06-902f-b235e1a40f06 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:03.491909 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-68297421-c49a-4b45-b8ae-990f6a4fa29b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:03.493309 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2ba72885-2a58-4a06-902f-b235e1a40f06 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1552 microversion: 2.1 time: 0.217321 Jul 25 08:48:03.493887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 165/309] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:03 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1552 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:03.498543 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-35517e63-daa3-4a5a-b7df-cfd9b246db54 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:03.499977 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-35517e63-daa3-4a5a-b7df-cfd9b246db54 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:03.500708 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-68297421-c49a-4b45-b8ae-990f6a4fa29b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.221866 Jul 25 08:48:03.502244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 145/310] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:03 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:03.506705 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-35517e63-daa3-4a5a-b7df-cfd9b246db54 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:03.507160 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-35517e63-daa3-4a5a-b7df-cfd9b246db54 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:03.507931 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-35517e63-daa3-4a5a-b7df-cfd9b246db54 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:03.508652 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-35517e63-daa3-4a5a-b7df-cfd9b246db54 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:03.570865 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-35517e63-daa3-4a5a-b7df-cfd9b246db54 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:03.578651 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-35517e63-daa3-4a5a-b7df-cfd9b246db54 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1217 microversion: 2.1 time: 0.083637 Jul 25 08:48:03.579196 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 166/311] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:03 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:04.514598 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-762cbd18-5dd0-4c42-830a-0a551f2061e4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:04.515245 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-762cbd18-5dd0-4c42-830a-0a551f2061e4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:04.521355 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-762cbd18-5dd0-4c42-830a-0a551f2061e4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:04.521811 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-762cbd18-5dd0-4c42-830a-0a551f2061e4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:04.522043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9456697c-900a-4a27-a98a-e0fe234654ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:04.522577 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-762cbd18-5dd0-4c42-830a-0a551f2061e4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:04.522685 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9456697c-900a-4a27-a98a-e0fe234654ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:04.523013 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-762cbd18-5dd0-4c42-830a-0a551f2061e4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:04.528745 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9456697c-900a-4a27-a98a-e0fe234654ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:04.529194 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9456697c-900a-4a27-a98a-e0fe234654ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:04.530456 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9456697c-900a-4a27-a98a-e0fe234654ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:04.530875 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9456697c-900a-4a27-a98a-e0fe234654ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:04.731283 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9456697c-900a-4a27-a98a-e0fe234654ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:04.734547 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-762cbd18-5dd0-4c42-830a-0a551f2061e4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:04.739353 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9456697c-900a-4a27-a98a-e0fe234654ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.221054 Jul 25 08:48:04.739925 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 167/312] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:04 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:04.743409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-762cbd18-5dd0-4c42-830a-0a551f2061e4 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1552 microversion: 2.1 time: 0.232251 Jul 25 08:48:04.744165 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 146/313] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:04 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1552 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:04.754940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2c20e893-12ee-4950-a786-b6f882f2a968 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:04.754940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2c20e893-12ee-4950-a786-b6f882f2a968 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:04.754940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c20e893-12ee-4950-a786-b6f882f2a968 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:04.754940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c20e893-12ee-4950-a786-b6f882f2a968 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:04.755280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c20e893-12ee-4950-a786-b6f882f2a968 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:04.755280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c20e893-12ee-4950-a786-b6f882f2a968 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:04.811644 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2c20e893-12ee-4950-a786-b6f882f2a968 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:04.818948 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2c20e893-12ee-4950-a786-b6f882f2a968 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1209 microversion: 2.1 time: 0.078088 Jul 25 08:48:04.819500 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 168/314] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:04 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1209 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:05.760526 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8b8de73c-2072-487d-a361-421d514b4502 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:05.761155 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-8b8de73c-2072-487d-a361-421d514b4502 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:05.764221 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2e41091c-44bf-48ea-97ca-9ce9bbb556e6 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:05.764879 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2e41091c-44bf-48ea-97ca-9ce9bbb556e6 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:05.767612 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8b8de73c-2072-487d-a361-421d514b4502 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:05.768065 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8b8de73c-2072-487d-a361-421d514b4502 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:05.768869 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8b8de73c-2072-487d-a361-421d514b4502 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:05.769310 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8b8de73c-2072-487d-a361-421d514b4502 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:05.770732 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e41091c-44bf-48ea-97ca-9ce9bbb556e6 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:05.771184 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e41091c-44bf-48ea-97ca-9ce9bbb556e6 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:05.771948 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e41091c-44bf-48ea-97ca-9ce9bbb556e6 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:05.772373 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e41091c-44bf-48ea-97ca-9ce9bbb556e6 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:05.970168 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2e41091c-44bf-48ea-97ca-9ce9bbb556e6 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:05.972711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8b8de73c-2072-487d-a361-421d514b4502 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:05.981217 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8b8de73c-2072-487d-a361-421d514b4502 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.225079 Jul 25 08:48:05.982039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 147/315] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:05 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:05.983783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2e41091c-44bf-48ea-97ca-9ce9bbb556e6 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1552 microversion: 2.1 time: 0.222466 Jul 25 08:48:05.984948 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 169/316] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:05 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1552 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:05.987885 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-50373fdd-e9c8-48a0-9822-ff27639a344b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:05.988887 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-50373fdd-e9c8-48a0-9822-ff27639a344b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:05.995490 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50373fdd-e9c8-48a0-9822-ff27639a344b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:05.996029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50373fdd-e9c8-48a0-9822-ff27639a344b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:05.997217 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50373fdd-e9c8-48a0-9822-ff27639a344b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:05.998109 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50373fdd-e9c8-48a0-9822-ff27639a344b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:06.016080 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:06.068194 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-50373fdd-e9c8-48a0-9822-ff27639a344b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:06.075445 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-50373fdd-e9c8-48a0-9822-ff27639a344b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1265 microversion: 2.1 time: 0.092182 Jul 25 08:48:06.076001 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 148/317] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:05 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:07.014478 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c076b54c-365e-4f6f-9d89-df6e6561e40f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:07.016215 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-cd996c63-7ef7-4bf8-a3c0-b2f9b85e6765 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:07.018043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c076b54c-365e-4f6f-9d89-df6e6561e40f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:07.027323 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-cd996c63-7ef7-4bf8-a3c0-b2f9b85e6765 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:07.054326 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c076b54c-365e-4f6f-9d89-df6e6561e40f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:07.054943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c076b54c-365e-4f6f-9d89-df6e6561e40f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:07.059665 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c076b54c-365e-4f6f-9d89-df6e6561e40f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:07.060162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cd996c63-7ef7-4bf8-a3c0-b2f9b85e6765 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:07.060899 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cd996c63-7ef7-4bf8-a3c0-b2f9b85e6765 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:07.062007 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c076b54c-365e-4f6f-9d89-df6e6561e40f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:07.065093 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cd996c63-7ef7-4bf8-a3c0-b2f9b85e6765 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:07.066115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cd996c63-7ef7-4bf8-a3c0-b2f9b85e6765 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:07.135116 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:07.238376 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-cd996c63-7ef7-4bf8-a3c0-b2f9b85e6765 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39f30010e94eb5862285347575f673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa18cc0817c848a782e4176af753e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:07.246492 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-cd996c63-7ef7-4bf8-a3c0-b2f9b85e6765 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 200 len: 1510 microversion: 2.1 time: 0.239513 Jul 25 08:48:07.255838 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 149/318] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:07 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:07.272144 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-fea234fb-a7c8-4833-853e-f62f90ecab65 req-a340430e-a66b-48f7-903e-1cc11d38fa38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c47421d-f63c-4f50-97c9-fe01898702c2", "name": "network-vif-deleted", "tag": "f611d792-f2ac-42c7-9f33-d791e3b88419"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:07.286386 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-fea234fb-a7c8-4833-853e-f62f90ecab65 req-a340430e-a66b-48f7-903e-1cc11d38fa38 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:07.287182 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-fea234fb-a7c8-4833-853e-f62f90ecab65 req-a340430e-a66b-48f7-903e-1cc11d38fa38 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:07.312646 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-fea234fb-a7c8-4833-853e-f62f90ecab65 req-a340430e-a66b-48f7-903e-1cc11d38fa38 service nova] Creating event network-vif-deleted:f611d792-f2ac-42c7-9f33-d791e3b88419 for instance 1c47421d-f63c-4f50-97c9-fe01898702c2 on hv-cinder-85084 Jul 25 08:48:07.319843 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-fea234fb-a7c8-4833-853e-f62f90ecab65 req-a340430e-a66b-48f7-903e-1cc11d38fa38 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062283 Jul 25 08:48:07.320894 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 150/319] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:48:07.327262 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4da0e9c0-0415-4d83-9537-462e4c2da4b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:07.328877 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4da0e9c0-0415-4d83-9537-462e4c2da4b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:07.338423 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4da0e9c0-0415-4d83-9537-462e4c2da4b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:07.339043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4da0e9c0-0415-4d83-9537-462e4c2da4b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:07.339959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4da0e9c0-0415-4d83-9537-462e4c2da4b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:07.340985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4da0e9c0-0415-4d83-9537-462e4c2da4b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:07.496728 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c076b54c-365e-4f6f-9d89-df6e6561e40f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:07.505453 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c076b54c-365e-4f6f-9d89-df6e6561e40f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.504195 Jul 25 08:48:07.519313 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 170/320] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:07 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:07.571656 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4da0e9c0-0415-4d83-9537-462e4c2da4b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:07.586190 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4da0e9c0-0415-4d83-9537-462e4c2da4b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1313 microversion: 2.1 time: 0.263801 Jul 25 08:48:07.586761 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 151/321] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:07 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:08.197233 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-bc75c779-5605-4b25-8cea-21d6ea97182d req-788da122-df8d-4e55-a33f-1076f5d1418e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b85fe19-05f7-422d-9f40-598eeb5ddb78", "tag": "24004cca-3635-4d32-9ca4-3abab8275df5"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:08.216067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-bc75c779-5605-4b25-8cea-21d6ea97182d req-788da122-df8d-4e55-a33f-1076f5d1418e service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:08.216433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-bc75c779-5605-4b25-8cea-21d6ea97182d req-788da122-df8d-4e55-a33f-1076f5d1418e service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:08.231591 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-bc75c779-5605-4b25-8cea-21d6ea97182d req-788da122-df8d-4e55-a33f-1076f5d1418e service nova] Creating event network-changed:24004cca-3635-4d32-9ca4-3abab8275df5 for instance 6b85fe19-05f7-422d-9f40-598eeb5ddb78 on hv-cinder-85084 Jul 25 08:48:08.236562 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-bc75c779-5605-4b25-8cea-21d6ea97182d req-788da122-df8d-4e55-a33f-1076f5d1418e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050339 Jul 25 08:48:08.237181 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 171/322] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:48:08.271024 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6e41383f-e8a7-4aa6-88e9-6588d7480d86 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:08.272208 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6e41383f-e8a7-4aa6-88e9-6588d7480d86 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:08.279287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e41383f-e8a7-4aa6-88e9-6588d7480d86 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:08.279748 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e41383f-e8a7-4aa6-88e9-6588d7480d86 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:08.280565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e41383f-e8a7-4aa6-88e9-6588d7480d86 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:08.281042 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e41383f-e8a7-4aa6-88e9-6588d7480d86 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:08.294780 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-6e41383f-e8a7-4aa6-88e9-6588d7480d86 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] HTTP exception thrown: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6e41383f-e8a7-4aa6-88e9-6588d7480d86 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Request method failure captured: Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 HTTP/1.1 Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEBb9s_SAxTNyTwJVjmMarSJBT1lX3VqIqLL3hSaD5uCMbfo3-Oxala8fhpyiz6-aNTUcNcaSW4gYQx7POlBcdfDuBla18N6Uop2jGh2BSsuIh9FdgodsyPkvBB96iXspCQq05Zh5mkeMfY1XeZW8SzXkUgPGz62y9oCxwogxu7iA Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: aa18cc0817c848a782e4176af753e3e8 Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:48:08.296960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aa18cc0817c848a782e4176af753e3e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aa18cc0817c848a782e4176af753e3e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aa18cc0817c848a782e4176af753e3e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aa18cc0817c848a782e4176af753e3e8"}]}] Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: aa18cc0817c848a782e4176af753e3e8 Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-DeleteServersTestJSON-812197761-project Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: bc39f30010e94eb5862285347575f673 Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-DeleteServersTestJSON-812197761-project Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:08.298469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '1c47421d-f63c-4f50-97c9-fe01898702c2'} Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:48:08.299240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:08.300344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:08.301331 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6e41383f-e8a7-4aa6-88e9-6588d7480d86 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Returning 404 to user: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:48:08.301331 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6e41383f-e8a7-4aa6-88e9-6588d7480d86 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 404 len: 111 microversion: 2.1 time: 0.031364 Jul 25 08:48:08.301331 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 152/323] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:08 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:48:08.433976 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-77868e43-d122-4108-be17-9c91bde4f647 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:08.438940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-77868e43-d122-4108-be17-9c91bde4f647 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:08.445590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77868e43-d122-4108-be17-9c91bde4f647 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:08.446274 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77868e43-d122-4108-be17-9c91bde4f647 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:08.447439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77868e43-d122-4108-be17-9c91bde4f647 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:08.448096 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77868e43-d122-4108-be17-9c91bde4f647 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:08.463858 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-77868e43-d122-4108-be17-9c91bde4f647 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] HTTP exception thrown: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-77868e43-d122-4108-be17-9c91bde4f647 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Request method failure captured: Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2/os-volume_attachments HTTP/1.1 Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhEBb9s_SAxTNyTwJVjmMarSJBT1lX3VqIqLL3hSaD5uCMbfo3-Oxala8fhpyiz6-aNTUcNcaSW4gYQx7POlBcdfDuBla18N6Uop2jGh2BSsuIh9FdgodsyPkvBB96iXspCQq05Zh5mkeMfY1XeZW8SzXkUgPGz62y9oCxwogxu7iA Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: aa18cc0817c848a782e4176af753e3e8 Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:48:08.469862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aa18cc0817c848a782e4176af753e3e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aa18cc0817c848a782e4176af753e3e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aa18cc0817c848a782e4176af753e3e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aa18cc0817c848a782e4176af753e3e8"}]}] Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: aa18cc0817c848a782e4176af753e3e8 Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-DeleteServersTestJSON-812197761-project Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: bc39f30010e94eb5862285347575f673 Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-DeleteServersTestJSON-812197761-project Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:08.471079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'server_id': '1c47421d-f63c-4f50-97c9-fe01898702c2'} Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:48:08.471739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:08.472833 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:08.477598 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-77868e43-d122-4108-be17-9c91bde4f647 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Returning 404 to user: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:48:08.479000 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-77868e43-d122-4108-be17-9c91bde4f647 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050473 Jul 25 08:48:08.479986 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 172/324] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:48:08 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:48:08.527186 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-36cdc0f1-cfb9-40b4-8053-6507288406d6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:08.532644 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-36cdc0f1-cfb9-40b4-8053-6507288406d6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:08.548161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-36cdc0f1-cfb9-40b4-8053-6507288406d6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:08.549507 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-36cdc0f1-cfb9-40b4-8053-6507288406d6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:08.552608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-36cdc0f1-cfb9-40b4-8053-6507288406d6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:08.553762 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-36cdc0f1-cfb9-40b4-8053-6507288406d6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:08.607722 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a69b9539-9d94-4359-929f-247fdbeb67b9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:08.609141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a69b9539-9d94-4359-929f-247fdbeb67b9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:08.621984 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a69b9539-9d94-4359-929f-247fdbeb67b9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:08.622728 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a69b9539-9d94-4359-929f-247fdbeb67b9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:08.624308 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a69b9539-9d94-4359-929f-247fdbeb67b9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:08.625195 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a69b9539-9d94-4359-929f-247fdbeb67b9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:08.849128 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-36cdc0f1-cfb9-40b4-8053-6507288406d6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:08.857046 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a69b9539-9d94-4359-929f-247fdbeb67b9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:08.858575 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-36cdc0f1-cfb9-40b4-8053-6507288406d6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.335738 Jul 25 08:48:08.859516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 153/325] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:08 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:08.866106 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a69b9539-9d94-4359-929f-247fdbeb67b9 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1313 microversion: 2.1 time: 0.262656 Jul 25 08:48:08.867107 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 173/326] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:08 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:09.819532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b47eb3a6-656b-4d4c-80eb-a46c611d3b34 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:09.820092 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b47eb3a6-656b-4d4c-80eb-a46c611d3b34 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:09.827448 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b47eb3a6-656b-4d4c-80eb-a46c611d3b34 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:09.827903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b47eb3a6-656b-4d4c-80eb-a46c611d3b34 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:09.828853 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b47eb3a6-656b-4d4c-80eb-a46c611d3b34 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:09.829298 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b47eb3a6-656b-4d4c-80eb-a46c611d3b34 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:09.842414 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-b47eb3a6-656b-4d4c-80eb-a46c611d3b34 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] HTTP exception thrown: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b47eb3a6-656b-4d4c-80eb-a46c611d3b34 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Request method failure captured: Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: DELETE /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 HTTP/1.1 Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEBb9s_SAxTNyTwJVjmMarSJBT1lX3VqIqLL3hSaD5uCMbfo3-Oxala8fhpyiz6-aNTUcNcaSW4gYQx7POlBcdfDuBla18N6Uop2jGh2BSsuIh9FdgodsyPkvBB96iXspCQq05Zh5mkeMfY1XeZW8SzXkUgPGz62y9oCxwogxu7iA Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: aa18cc0817c848a782e4176af753e3e8 Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:48:09.843953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aa18cc0817c848a782e4176af753e3e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aa18cc0817c848a782e4176af753e3e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aa18cc0817c848a782e4176af753e3e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aa18cc0817c848a782e4176af753e3e8"}]}] Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: aa18cc0817c848a782e4176af753e3e8 Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-DeleteServersTestJSON-812197761-project Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: bc39f30010e94eb5862285347575f673 Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-DeleteServersTestJSON-812197761-project Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:09.845200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '1c47421d-f63c-4f50-97c9-fe01898702c2'} Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:48:09.845904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:09.847111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:09.848259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b47eb3a6-656b-4d4c-80eb-a46c611d3b34 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Returning 404 to user: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:48:09.848259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b47eb3a6-656b-4d4c-80eb-a46c611d3b34 tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 404 len: 111 microversion: 2.1 time: 0.029992 Jul 25 08:48:09.848259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 154/327] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:48:09 2022] DELETE /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:48:09.853655 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b8983722-dbe2-4e62-b086-b2275b5c61fe tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:09.854267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b8983722-dbe2-4e62-b086-b2275b5c61fe tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] [instance: 1c47421d-f63c-4f50-97c9-fe01898702c2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:09.856228 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=68 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:09.861363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8983722-dbe2-4e62-b086-b2275b5c61fe tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:09.861816 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8983722-dbe2-4e62-b086-b2275b5c61fe tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:09.862584 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8983722-dbe2-4e62-b086-b2275b5c61fe tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:09.863136 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8983722-dbe2-4e62-b086-b2275b5c61fe tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:09.877210 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-b8983722-dbe2-4e62-b086-b2275b5c61fe tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] HTTP exception thrown: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b8983722-dbe2-4e62-b086-b2275b5c61fe tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Request method failure captured: Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 HTTP/1.1 Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhEBb9s_SAxTNyTwJVjmMarSJBT1lX3VqIqLL3hSaD5uCMbfo3-Oxala8fhpyiz6-aNTUcNcaSW4gYQx7POlBcdfDuBla18N6Uop2jGh2BSsuIh9FdgodsyPkvBB96iXspCQq05Zh5mkeMfY1XeZW8SzXkUgPGz62y9oCxwogxu7iA Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: aa18cc0817c848a782e4176af753e3e8 Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:48:09.879331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aa18cc0817c848a782e4176af753e3e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aa18cc0817c848a782e4176af753e3e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aa18cc0817c848a782e4176af753e3e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aa18cc0817c848a782e4176af753e3e8"}]}] Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: aa18cc0817c848a782e4176af753e3e8 Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-DeleteServersTestJSON-812197761 Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-DeleteServersTestJSON-812197761-project Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: bc39f30010e94eb5862285347575f673 Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-DeleteServersTestJSON-812197761-project Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:09.880613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '1c47421d-f63c-4f50-97c9-fe01898702c2'} Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:48:09.881276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. Jul 25 08:48:09.883279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:09.884229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9282d828-3a64-49b8-a9e1-8c72f82aebdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:09.884307 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b8983722-dbe2-4e62-b086-b2275b5c61fe tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] Returning 404 to user: Instance 1c47421d-f63c-4f50-97c9-fe01898702c2 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:48:09.884387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9282d828-3a64-49b8-a9e1-8c72f82aebdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:09.884468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b8983722-dbe2-4e62-b086-b2275b5c61fe tempest-DeleteServersTestJSON-812197761 tempest-DeleteServersTestJSON-812197761-project] 10.222.0.52 "GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2" status: 404 len: 111 microversion: 2.1 time: 0.030842 Jul 25 08:48:09.884468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 174/328] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:09 2022] GET /compute/v2.1/servers/1c47421d-f63c-4f50-97c9-fe01898702c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 08:48:09.889143 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9282d828-3a64-49b8-a9e1-8c72f82aebdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:09.890218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9282d828-3a64-49b8-a9e1-8c72f82aebdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:09.890789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9282d828-3a64-49b8-a9e1-8c72f82aebdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:09.891216 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9282d828-3a64-49b8-a9e1-8c72f82aebdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:09.899426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d65e5a5f-8f53-465b-bb11-1d9eee850ef2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:09.899426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d65e5a5f-8f53-465b-bb11-1d9eee850ef2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:09.904287 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d65e5a5f-8f53-465b-bb11-1d9eee850ef2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:09.904809 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d65e5a5f-8f53-465b-bb11-1d9eee850ef2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:09.905585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d65e5a5f-8f53-465b-bb11-1d9eee850ef2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:09.906024 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d65e5a5f-8f53-465b-bb11-1d9eee850ef2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:10.076794 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:10.097309 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=6 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:10.210846 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9282d828-3a64-49b8-a9e1-8c72f82aebdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:10.218918 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9282d828-3a64-49b8-a9e1-8c72f82aebdf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.343073 Jul 25 08:48:10.219743 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 155/329] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:09 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:10.224828 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:10.246156 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d65e5a5f-8f53-465b-bb11-1d9eee850ef2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:10.257617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d65e5a5f-8f53-465b-bb11-1d9eee850ef2 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1313 microversion: 2.1 time: 0.364023 Jul 25 08:48:10.261755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 175/330] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:09 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:11.243376 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3f9b9372-02b3-426c-b201-ba16797b45b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:11.243998 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3f9b9372-02b3-426c-b201-ba16797b45b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:11.256247 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f9b9372-02b3-426c-b201-ba16797b45b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:11.257464 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f9b9372-02b3-426c-b201-ba16797b45b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:11.258950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f9b9372-02b3-426c-b201-ba16797b45b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:11.259684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3f9b9372-02b3-426c-b201-ba16797b45b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:11.285758 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b35b8aff-1f10-4759-80fd-98ccafd5f1b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:11.286602 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b35b8aff-1f10-4759-80fd-98ccafd5f1b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:11.301172 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b35b8aff-1f10-4759-80fd-98ccafd5f1b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:11.302085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b35b8aff-1f10-4759-80fd-98ccafd5f1b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:11.305481 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b35b8aff-1f10-4759-80fd-98ccafd5f1b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:11.306406 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b35b8aff-1f10-4759-80fd-98ccafd5f1b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:11.706134 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3f9b9372-02b3-426c-b201-ba16797b45b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:11.724955 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3f9b9372-02b3-426c-b201-ba16797b45b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.477671 Jul 25 08:48:11.728326 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 156/331] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:11 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:11.752541 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b35b8aff-1f10-4759-80fd-98ccafd5f1b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:11.767025 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b35b8aff-1f10-4759-80fd-98ccafd5f1b8 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1313 microversion: 2.1 time: 0.485557 Jul 25 08:48:11.773460 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 176/332] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:11 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:12.754994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9a1c93a4-ccd9-4a3f-98e6-801b9a37ee90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:12.756387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9a1c93a4-ccd9-4a3f-98e6-801b9a37ee90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:12.766786 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a1c93a4-ccd9-4a3f-98e6-801b9a37ee90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:12.767612 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a1c93a4-ccd9-4a3f-98e6-801b9a37ee90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:12.769596 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a1c93a4-ccd9-4a3f-98e6-801b9a37ee90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:12.773992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a1c93a4-ccd9-4a3f-98e6-801b9a37ee90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:12.798412 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-965ec448-81ca-44c1-9f88-22495bd1b9d4 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:12.799553 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-965ec448-81ca-44c1-9f88-22495bd1b9d4 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:12.822180 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-965ec448-81ca-44c1-9f88-22495bd1b9d4 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:12.823068 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-965ec448-81ca-44c1-9f88-22495bd1b9d4 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:12.824109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-965ec448-81ca-44c1-9f88-22495bd1b9d4 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:12.825273 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-965ec448-81ca-44c1-9f88-22495bd1b9d4 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:13.142579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9a1c93a4-ccd9-4a3f-98e6-801b9a37ee90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:13.159462 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9a1c93a4-ccd9-4a3f-98e6-801b9a37ee90 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.410648 Jul 25 08:48:13.160280 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 157/333] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:12 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:13.221728 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-965ec448-81ca-44c1-9f88-22495bd1b9d4 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:13.233563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-965ec448-81ca-44c1-9f88-22495bd1b9d4 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1313 microversion: 2.1 time: 0.439541 Jul 25 08:48:13.246250 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 177/334] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:12 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:14.182817 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9fe88be1-536b-492a-938c-7b677e677968 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:14.183381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9fe88be1-536b-492a-938c-7b677e677968 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:14.205325 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9fe88be1-536b-492a-938c-7b677e677968 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:14.206112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9fe88be1-536b-492a-938c-7b677e677968 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:14.207147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9fe88be1-536b-492a-938c-7b677e677968 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:14.207647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9fe88be1-536b-492a-938c-7b677e677968 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:14.259358 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-72353df1-9584-491f-8a1e-5a82e88852fc tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:14.260039 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-72353df1-9584-491f-8a1e-5a82e88852fc tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:14.285425 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-72353df1-9584-491f-8a1e-5a82e88852fc tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:14.286025 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-72353df1-9584-491f-8a1e-5a82e88852fc tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:14.286901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-72353df1-9584-491f-8a1e-5a82e88852fc tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:14.288463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-72353df1-9584-491f-8a1e-5a82e88852fc tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:14.495911 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9fe88be1-536b-492a-938c-7b677e677968 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:14.506386 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9fe88be1-536b-492a-938c-7b677e677968 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.329106 Jul 25 08:48:14.510886 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 158/335] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:14 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:14.512880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-72353df1-9584-491f-8a1e-5a82e88852fc tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:14.521016 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-72353df1-9584-491f-8a1e-5a82e88852fc tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1313 microversion: 2.1 time: 0.265630 Jul 25 08:48:14.521592 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 178/336] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:14 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:14.805500 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-fe6b80ec-df7b-452f-84e3-cd41f7c9719a req-d1029781-1ab9-4d74-b965-42c645cfc1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b85fe19-05f7-422d-9f40-598eeb5ddb78", "name": "network-vif-plugged", "status": "completed", "tag": "24004cca-3635-4d32-9ca4-3abab8275df5"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:14.823960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:14.836025 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-fe6b80ec-df7b-452f-84e3-cd41f7c9719a req-d1029781-1ab9-4d74-b965-42c645cfc1fa service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:14.836472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-fe6b80ec-df7b-452f-84e3-cd41f7c9719a req-d1029781-1ab9-4d74-b965-42c645cfc1fa service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:14.863772 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-fe6b80ec-df7b-452f-84e3-cd41f7c9719a req-d1029781-1ab9-4d74-b965-42c645cfc1fa service nova] Creating event network-vif-plugged:24004cca-3635-4d32-9ca4-3abab8275df5 for instance 6b85fe19-05f7-422d-9f40-598eeb5ddb78 on hv-cinder-85084 Jul 25 08:48:14.877702 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-fe6b80ec-df7b-452f-84e3-cd41f7c9719a req-d1029781-1ab9-4d74-b965-42c645cfc1fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075882 Jul 25 08:48:14.879684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 159/337] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:48:15.533598 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-332c7f54-8f2e-466e-8c91-9440ef604d49 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:15.534866 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-332c7f54-8f2e-466e-8c91-9440ef604d49 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:15.542512 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-332c7f54-8f2e-466e-8c91-9440ef604d49 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:15.542908 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1ea69638-120e-41b7-84ee-32e4d885ebed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:15.543696 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-332c7f54-8f2e-466e-8c91-9440ef604d49 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:15.544091 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1ea69638-120e-41b7-84ee-32e4d885ebed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:15.544894 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-332c7f54-8f2e-466e-8c91-9440ef604d49 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:15.545550 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-332c7f54-8f2e-466e-8c91-9440ef604d49 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:15.553730 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1ea69638-120e-41b7-84ee-32e4d885ebed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:15.554403 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1ea69638-120e-41b7-84ee-32e4d885ebed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:15.555243 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1ea69638-120e-41b7-84ee-32e4d885ebed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:15.555879 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1ea69638-120e-41b7-84ee-32e4d885ebed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:15.982300 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-332c7f54-8f2e-466e-8c91-9440ef604d49 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:15.985297 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1ea69638-120e-41b7-84ee-32e4d885ebed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:15.990843 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-332c7f54-8f2e-466e-8c91-9440ef604d49 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.461323 Jul 25 08:48:15.994173 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1ea69638-120e-41b7-84ee-32e4d885ebed tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1313 microversion: 2.1 time: 0.456152 Jul 25 08:48:16.005010 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 160/339] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:15 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:16.005178 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 179/339] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:15 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:17.014781 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b480253c-a8f7-4ebc-a456-62cba211ce17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:17.016610 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b480253c-a8f7-4ebc-a456-62cba211ce17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:17.019291 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-afca05d1-3420-4dc7-b746-990acee8a30a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:17.019989 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-afca05d1-3420-4dc7-b746-990acee8a30a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:17.028210 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-afca05d1-3420-4dc7-b746-990acee8a30a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:17.028968 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-afca05d1-3420-4dc7-b746-990acee8a30a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:17.030595 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-afca05d1-3420-4dc7-b746-990acee8a30a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:17.031227 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-afca05d1-3420-4dc7-b746-990acee8a30a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:17.037405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b480253c-a8f7-4ebc-a456-62cba211ce17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:17.038383 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b480253c-a8f7-4ebc-a456-62cba211ce17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:17.039189 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b480253c-a8f7-4ebc-a456-62cba211ce17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:17.039623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b480253c-a8f7-4ebc-a456-62cba211ce17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:17.271301 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-afca05d1-3420-4dc7-b746-990acee8a30a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:17.291742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-afca05d1-3420-4dc7-b746-990acee8a30a tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1497 microversion: 2.1 time: 0.277619 Jul 25 08:48:17.296357 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 161/340] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:17 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:17.311354 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b480253c-a8f7-4ebc-a456-62cba211ce17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:17.321940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b480253c-a8f7-4ebc-a456-62cba211ce17 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.312307 Jul 25 08:48:17.322708 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 180/341] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:17 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:18.093238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5c6dc20e-5162-42d2-80d4-b88814ad02bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:18.094237 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5c6dc20e-5162-42d2-80d4-b88814ad02bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:18.101667 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c6dc20e-5162-42d2-80d4-b88814ad02bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:18.102111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c6dc20e-5162-42d2-80d4-b88814ad02bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:18.103185 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c6dc20e-5162-42d2-80d4-b88814ad02bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:18.103621 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c6dc20e-5162-42d2-80d4-b88814ad02bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:18.136999 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5c6dc20e-5162-42d2-80d4-b88814ad02bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:48:18.314284 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5c6dc20e-5162-42d2-80d4-b88814ad02bf tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 204 len: 0 microversion: 2.1 time: 0.223855 Jul 25 08:48:18.315318 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 162/342] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:48:18 2022] DELETE /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:48:18.323582 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ff49ead6-d033-4498-a579-3950adb9ee5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:18.324345 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ff49ead6-d033-4498-a579-3950adb9ee5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:18.334161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff49ead6-d033-4498-a579-3950adb9ee5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:18.334616 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff49ead6-d033-4498-a579-3950adb9ee5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:18.335456 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff49ead6-d033-4498-a579-3950adb9ee5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:18.335821 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff49ead6-d033-4498-a579-3950adb9ee5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:18.351427 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d684bb5e-bfa6-4fc3-a065-b9fee5ff529e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:18.352493 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d684bb5e-bfa6-4fc3-a065-b9fee5ff529e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:18.381445 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d684bb5e-bfa6-4fc3-a065-b9fee5ff529e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:18.382442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d684bb5e-bfa6-4fc3-a065-b9fee5ff529e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:18.384089 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d684bb5e-bfa6-4fc3-a065-b9fee5ff529e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:18.390051 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d684bb5e-bfa6-4fc3-a065-b9fee5ff529e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:18.667559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ff49ead6-d033-4498-a579-3950adb9ee5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:18.675443 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ff49ead6-d033-4498-a579-3950adb9ee5f tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1503 microversion: 2.1 time: 0.355772 Jul 25 08:48:18.676030 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 181/343] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:18 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:18.733452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d684bb5e-bfa6-4fc3-a065-b9fee5ff529e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:18.742254 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d684bb5e-bfa6-4fc3-a065-b9fee5ff529e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.395773 Jul 25 08:48:18.743166 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 163/344] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:18 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:19.703430 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2c4e3b01-d436-451a-82b4-518aaa5d1c39 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:19.704779 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2c4e3b01-d436-451a-82b4-518aaa5d1c39 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:19.727214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c4e3b01-d436-451a-82b4-518aaa5d1c39 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:19.728111 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c4e3b01-d436-451a-82b4-518aaa5d1c39 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:19.729844 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c4e3b01-d436-451a-82b4-518aaa5d1c39 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:19.730647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c4e3b01-d436-451a-82b4-518aaa5d1c39 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:19.763394 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-62348a66-824c-4de0-8997-a7acc2e18915 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:19.765216 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-62348a66-824c-4de0-8997-a7acc2e18915 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:19.776555 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-62348a66-824c-4de0-8997-a7acc2e18915 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:19.778342 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-62348a66-824c-4de0-8997-a7acc2e18915 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:19.779209 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-62348a66-824c-4de0-8997-a7acc2e18915 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:19.780233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-62348a66-824c-4de0-8997-a7acc2e18915 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:20.080037 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2c4e3b01-d436-451a-82b4-518aaa5d1c39 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:20.089186 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2c4e3b01-d436-451a-82b4-518aaa5d1c39 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1503 microversion: 2.1 time: 0.395302 Jul 25 08:48:20.093624 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 182/345] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:19 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1503 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:20.099189 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-62348a66-824c-4de0-8997-a7acc2e18915 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:20.114179 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-62348a66-824c-4de0-8997-a7acc2e18915 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.354352 Jul 25 08:48:20.115457 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 164/346] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:19 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:21.115650 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9361605b-58ee-4efb-8ad7-579bc60a2d28 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:21.116322 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9361605b-58ee-4efb-8ad7-579bc60a2d28 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:21.126172 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9361605b-58ee-4efb-8ad7-579bc60a2d28 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:21.126626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9361605b-58ee-4efb-8ad7-579bc60a2d28 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:21.127406 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9361605b-58ee-4efb-8ad7-579bc60a2d28 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:21.127839 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9361605b-58ee-4efb-8ad7-579bc60a2d28 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:21.139607 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ce8281af-229f-41ed-81c6-4d9f65f3552f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:21.141269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ce8281af-229f-41ed-81c6-4d9f65f3552f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:21.152608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ce8281af-229f-41ed-81c6-4d9f65f3552f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:21.154219 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ce8281af-229f-41ed-81c6-4d9f65f3552f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:21.156117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ce8281af-229f-41ed-81c6-4d9f65f3552f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:21.157059 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ce8281af-229f-41ed-81c6-4d9f65f3552f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:21.454203 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9361605b-58ee-4efb-8ad7-579bc60a2d28 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:21.465086 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9361605b-58ee-4efb-8ad7-579bc60a2d28 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1503 microversion: 2.1 time: 0.351804 Jul 25 08:48:21.468469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 183/347] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:21 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1503 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:21.686858 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ce8281af-229f-41ed-81c6-4d9f65f3552f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:21.696870 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:21.706781 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ce8281af-229f-41ed-81c6-4d9f65f3552f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.570324 Jul 25 08:48:21.708847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 165/348] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:21 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:22.499194 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1196bf41-2670-44f1-9c84-15660cb0dc6b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:22.501861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1196bf41-2670-44f1-9c84-15660cb0dc6b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:22.522289 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1196bf41-2670-44f1-9c84-15660cb0dc6b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:22.529682 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1196bf41-2670-44f1-9c84-15660cb0dc6b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:22.531656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1196bf41-2670-44f1-9c84-15660cb0dc6b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:22.533614 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1196bf41-2670-44f1-9c84-15660cb0dc6b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:22.728019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e0bdcf56-bcac-489b-963e-922a4170dae6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:22.729443 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e0bdcf56-bcac-489b-963e-922a4170dae6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:22.765726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e0bdcf56-bcac-489b-963e-922a4170dae6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:22.767417 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e0bdcf56-bcac-489b-963e-922a4170dae6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:22.771252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e0bdcf56-bcac-489b-963e-922a4170dae6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:22.774731 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e0bdcf56-bcac-489b-963e-922a4170dae6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:23.334267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1196bf41-2670-44f1-9c84-15660cb0dc6b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:23.356315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1196bf41-2670-44f1-9c84-15660cb0dc6b tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1503 microversion: 2.1 time: 0.868256 Jul 25 08:48:23.360339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 184/349] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:22 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1503 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:23.464311 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e0bdcf56-bcac-489b-963e-922a4170dae6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:23.478721 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e0bdcf56-bcac-489b-963e-922a4170dae6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.754625 Jul 25 08:48:23.479327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 166/350] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:22 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:24.013670 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-039b03db-36c4-4a34-b465-a7cc72c26325 req-61e0872c-02eb-408b-83da-2a31693c70ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b85fe19-05f7-422d-9f40-598eeb5ddb78", "name": "network-vif-deleted", "tag": "24004cca-3635-4d32-9ca4-3abab8275df5"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:24.088035 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-039b03db-36c4-4a34-b465-a7cc72c26325 req-61e0872c-02eb-408b-83da-2a31693c70ec service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:24.090986 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-039b03db-36c4-4a34-b465-a7cc72c26325 req-61e0872c-02eb-408b-83da-2a31693c70ec service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:24.115360 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-039b03db-36c4-4a34-b465-a7cc72c26325 req-61e0872c-02eb-408b-83da-2a31693c70ec service nova] Creating event network-vif-deleted:24004cca-3635-4d32-9ca4-3abab8275df5 for instance 6b85fe19-05f7-422d-9f40-598eeb5ddb78 on hv-cinder-85084 Jul 25 08:48:24.140918 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-039b03db-36c4-4a34-b465-a7cc72c26325 req-61e0872c-02eb-408b-83da-2a31693c70ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132828 Jul 25 08:48:24.142445 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 167/351] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:48:24.232128 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dcec75d8-286e-4feb-a0d6-6edce6411a9f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Action: 'create', calling method: .version_select at 0x7f0f79bd1790>, body: {"keypair": {"name": "tempest-keypair-1962024034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJxLJ2VC+ufB0iuLEU5gBcKw/w3owh8oBRtNH4AEKTg9vClsID0RR9X4f+MITACl9lVAEroE84sjTuvHxkC45SPCWXCaVMIXUFipAhDy0LGFm4E7aREDLLWSTMk0+1ibQ=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:24.250547 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-dcec75d8-286e-4feb-a0d6-6edce6411a9f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Getting quotas for project f3491b85dc4543c88f500828b2df1d2d. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:48:24.266963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-dcec75d8-286e-4feb-a0d6-6edce6411a9f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Getting quotas for user d3f0b30685e94f83883d682731644a89 and project f3491b85dc4543c88f500828b2df1d2d. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:48:24.305963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dcec75d8-286e-4feb-a0d6-6edce6411a9f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.729718 Jul 25 08:48:24.314391 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 185/352] 10.222.0.52 () {62 vars in 1200 bytes} [Mon Jul 25 08:48:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 743 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 08:48:24.381684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:24.383099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:24.395437 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:24.396606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:24.397495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:24.398033 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:24.438058 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:24.438873 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:24.439537 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.objects.instance [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lazy-loading 'fault' on Instance uuid 6b85fe19-05f7-422d-9f40-598eeb5ddb78 {{(pid=124234) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:48:24.504938 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-88110b25-b159-4bcb-b556-9b761e84b7cf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:24.506195 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-88110b25-b159-4bcb-b556-9b761e84b7cf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:24.534050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88110b25-b159-4bcb-b556-9b761e84b7cf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:24.536342 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88110b25-b159-4bcb-b556-9b761e84b7cf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:24.541438 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88110b25-b159-4bcb-b556-9b761e84b7cf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:24.545416 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88110b25-b159-4bcb-b556-9b761e84b7cf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:24.572400 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0c0131372345e6b23260b466ec8ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd358c71209624c55b7db08cc3435dbcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:24.581298 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-69e9671c-1a87-422b-b782-5aebe4c7588e tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 200 len: 1303 microversion: 2.1 time: 0.204953 Jul 25 08:48:24.586562 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 168/353] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:24 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 1303 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:25.154939 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-88110b25-b159-4bcb-b556-9b761e84b7cf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:25.166231 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-88110b25-b159-4bcb-b556-9b761e84b7cf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1502 microversion: 2.1 time: 0.666404 Jul 25 08:48:25.177088 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 186/354] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:24 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1502 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:25.191029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5dddd040-ec56-4b17-ad69-6b9ef5bed3d0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93fe84f2-5557-4f72-9200-6b937f626056"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:25.193266 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5dddd040-ec56-4b17-ad69-6b9ef5bed3d0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:25.212899 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5dddd040-ec56-4b17-ad69-6b9ef5bed3d0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:25.215120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5dddd040-ec56-4b17-ad69-6b9ef5bed3d0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:25.216159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5dddd040-ec56-4b17-ad69-6b9ef5bed3d0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:25.218543 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5dddd040-ec56-4b17-ad69-6b9ef5bed3d0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:25.276720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-5dddd040-ec56-4b17-ad69-6b9ef5bed3d0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] HTTP exception thrown: Cannot 'attach_volume' instance 22b16067-f13e-472e-a335-bbb66b7461b1 while it is in vm_state rescued Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5dddd040-ec56-4b17-ad69-6b9ef5bed3d0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Request method failure captured: Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: POST /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1/os-volume_attachments HTTP/1.1 Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 74 Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhAbHY67eQxIEbP7uZC63trv3RWNmE-jA4q-qfVkwamHlJqpEvc9tsVw9uR3CcU_zn9g9_Dy0hO19YlfNuDeBVc1FSa_xWLpptwFIXoXVOM5EcH3hxmFKKY6Sz8lkr-u8AfiW9Ly8IisZN4Iel1ZrDcboWjDo93zC7CUxuq-gvQGSs Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 7e61cbb537384f549eee9ec4c92d9d77 Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:48:25.278959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e61cbb537384f549eee9ec4c92d9d77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7e61cbb537384f549eee9ec4c92d9d77", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7e61cbb537384f549eee9ec4c92d9d77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e61cbb537384f549eee9ec4c92d9d77"}]}] Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 7e61cbb537384f549eee9ec4c92d9d77 Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-ServerRescueNegativeTestJSON-1864573966-project Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 238f78244df546e5a6fc1a4cd1b73288 Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1864573966-project Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {"volumeAttachment": {"volumeId": "93fe84f2-5557-4f72-9200-6b937f626056"}} Jul 25 08:48:25.280327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Cannot 'attach_volume' instance 22b16067-f13e-472e-a335-bbb66b7461b1 while it is in vm_state rescued Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'server_id': '22b16067-f13e-472e-a335-bbb66b7461b1', 'body': {'volumeAttachment': {'volumeId': '93fe84f2-5557-4f72-9200-6b937f626056'}}} Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 22b16067-f13e-472e-a335-bbb66b7461b1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:48:25.281594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 22b16067-f13e-472e-a335-bbb66b7461b1 while it is in vm_state rescued Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:25.282745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:25.283859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:48:25.283859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:48:25.283859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 22b16067-f13e-472e-a335-bbb66b7461b1 while it is in vm_state rescued Jul 25 08:48:25.283859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:48:25.283859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5dddd040-ec56-4b17-ad69-6b9ef5bed3d0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Returning 409 to user: Cannot 'attach_volume' instance 22b16067-f13e-472e-a335-bbb66b7461b1 while it is in vm_state rescued {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:48:25.283859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5dddd040-ec56-4b17-ad69-6b9ef5bed3d0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.095355 Jul 25 08:48:25.296215 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 169/355] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:48:25 2022] POST /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1/os-volume_attachments => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 08:48:25.304881 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7542e68e-5a95-44aa-807a-9592c9e7b89c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:25.305403 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7542e68e-5a95-44aa-807a-9592c9e7b89c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:25.321546 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7542e68e-5a95-44aa-807a-9592c9e7b89c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:25.322018 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7542e68e-5a95-44aa-807a-9592c9e7b89c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:25.322798 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7542e68e-5a95-44aa-807a-9592c9e7b89c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:25.326883 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7542e68e-5a95-44aa-807a-9592c9e7b89c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:25.478094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7542e68e-5a95-44aa-807a-9592c9e7b89c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1/action" status: 202 len: 0 microversion: 2.1 time: 0.182237 Jul 25 08:48:25.479383 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 187/356] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:48:25 2022] POST /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 08:48:25.488350 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f1594737-1c6a-4115-aa1f-2da9ce242ebd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:25.489304 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f1594737-1c6a-4115-aa1f-2da9ce242ebd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:25.496636 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1594737-1c6a-4115-aa1f-2da9ce242ebd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:25.500072 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1594737-1c6a-4115-aa1f-2da9ce242ebd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:25.501134 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1594737-1c6a-4115-aa1f-2da9ce242ebd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:25.501770 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1594737-1c6a-4115-aa1f-2da9ce242ebd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:25.611158 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b8cb43a6-5b54-47fb-b53c-d58c56485f21 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:25.611949 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b8cb43a6-5b54-47fb-b53c-d58c56485f21 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] [instance: 6b85fe19-05f7-422d-9f40-598eeb5ddb78] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:25.630201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8cb43a6-5b54-47fb-b53c-d58c56485f21 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:25.630802 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8cb43a6-5b54-47fb-b53c-d58c56485f21 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:25.631896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8cb43a6-5b54-47fb-b53c-d58c56485f21 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:25.632868 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8cb43a6-5b54-47fb-b53c-d58c56485f21 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:25.663709 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-b8cb43a6-5b54-47fb-b53c-d58c56485f21 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] HTTP exception thrown: Instance 6b85fe19-05f7-422d-9f40-598eeb5ddb78 could not be found. Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b8cb43a6-5b54-47fb-b53c-d58c56485f21 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Request method failure captured: Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 HTTP/1.1 Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lh2lb8SpVqNK2uS0WG5DSNKNCfP_wtRlhbSyH8-81Oi77p_-7981C4BsPi_bBweytoiqWOk-SvxFUNO7pX57wwSQwWj6D0byc7HUZ8BcsyToVTVHKwPM52vILBx7NMXktcncvE3TFQYaG_wD_W0qFjY5oK9_7Jcag3X_fknMstp7So Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: d358c71209624c55b7db08cc3435dbcb Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesActionsTest-1341318003 Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:48:25.666104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d358c71209624c55b7db08cc3435dbcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d358c71209624c55b7db08cc3435dbcb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d358c71209624c55b7db08cc3435dbcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d358c71209624c55b7db08cc3435dbcb"}]}] Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesActionsTest-1341318003 Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: d358c71209624c55b7db08cc3435dbcb Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesActionsTest-1341318003 Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesActionsTest-1341318003-project Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: bf0c0131372345e6b23260b466ec8ff9 Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesActionsTest-1341318003-project Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 6b85fe19-05f7-422d-9f40-598eeb5ddb78 could not be found. Jul 25 08:48:25.668296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '6b85fe19-05f7-422d-9f40-598eeb5ddb78'} Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b85fe19-05f7-422d-9f40-598eeb5ddb78 could not be found. Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:48:25.669332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b85fe19-05f7-422d-9f40-598eeb5ddb78 could not be found. Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b85fe19-05f7-422d-9f40-598eeb5ddb78 could not be found. Jul 25 08:48:25.671364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:48:25.676845 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b8cb43a6-5b54-47fb-b53c-d58c56485f21 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] Returning 404 to user: Instance 6b85fe19-05f7-422d-9f40-598eeb5ddb78 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:48:25.678669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b8cb43a6-5b54-47fb-b53c-d58c56485f21 tempest-VolumesActionsTest-1341318003 tempest-VolumesActionsTest-1341318003-project] 10.222.0.52 "GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78" status: 404 len: 111 microversion: 2.1 time: 0.074857 Jul 25 08:48:25.680768 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 188/357] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:25 2022] GET /compute/v2.1/servers/6b85fe19-05f7-422d-9f40-598eeb5ddb78 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 08:48:26.411260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f1594737-1c6a-4115-aa1f-2da9ce242ebd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:26.432840 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f1594737-1c6a-4115-aa1f-2da9ce242ebd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1510 microversion: 2.1 time: 0.942099 Jul 25 08:48:26.433740 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 170/358] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:25 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1510 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:27.462194 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bfe14fbe-940b-49e1-9541-a6f97379857d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:27.462812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bfe14fbe-940b-49e1-9541-a6f97379857d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:27.478508 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bfe14fbe-940b-49e1-9541-a6f97379857d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:27.478972 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bfe14fbe-940b-49e1-9541-a6f97379857d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:27.481108 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bfe14fbe-940b-49e1-9541-a6f97379857d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:27.481837 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bfe14fbe-940b-49e1-9541-a6f97379857d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:27.505580 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2095585343", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81feca48-2aba-4dcd-848a-634aff6ea348"}], "security_groups": [{"name": "tempest-securitygroup--128550884"}], "key_name": "tempest-keypair-1962024034", "user_data": "}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:27.799971 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.network.neutron [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] validate_networks() for [('81feca48-2aba-4dcd-848a-634aff6ea348', None, None, None, None, None)] {{(pid=124234) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:48:28.068346 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bfe14fbe-940b-49e1-9541-a6f97379857d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:28.070865 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:28.091060 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bfe14fbe-940b-49e1-9541-a6f97379857d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1510 microversion: 2.1 time: 0.633732 Jul 25 08:48:28.091778 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 189/359] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:27 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:28.824002 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Flavor limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:48:28.824499 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Image limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:48:28.824931 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Flavor pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:48:28.825334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Image pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:48:28.825755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:48:28.854048 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:28.854597 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:28.855545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:28.855977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:28.917933 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Getting quotas for project f3491b85dc4543c88f500828b2df1d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:48:28.925004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Getting quotas for user d3f0b30685e94f83883d682731644a89 and project f3491b85dc4543c88f500828b2df1d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:48:28.960209 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Going to run 1 instances... {{(pid=124234) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:48:28.966338 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124234) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:48:29.081532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-231ecf9f-c9c0-4505-84d7-f99b40e5b186 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.583381 Jul 25 08:48:29.082447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 171/360] 10.222.0.52 () {62 vars in 1188 bytes} [Mon Jul 25 08:48:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 25 08:48:29.095688 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9eebfa1e-c336-488b-942e-09222aa6acb1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:29.096310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9eebfa1e-c336-488b-942e-09222aa6acb1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:29.116373 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c4d342bf-f38a-4137-9b9a-065a9f816670 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:29.117029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c4d342bf-f38a-4137-9b9a-065a9f816670 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:29.145560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c4d342bf-f38a-4137-9b9a-065a9f816670 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:29.147062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c4d342bf-f38a-4137-9b9a-065a9f816670 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:29.148043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c4d342bf-f38a-4137-9b9a-065a9f816670 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:29.148484 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c4d342bf-f38a-4137-9b9a-065a9f816670 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:29.238877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9eebfa1e-c336-488b-942e-09222aa6acb1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:29.248190 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9eebfa1e-c336-488b-942e-09222aa6acb1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:29.249744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9eebfa1e-c336-488b-942e-09222aa6acb1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:29.250862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9eebfa1e-c336-488b-942e-09222aa6acb1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1282 microversion: 2.20 time: 0.161373 Jul 25 08:48:29.251401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 190/361] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:29 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:29.604282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c4d342bf-f38a-4137-9b9a-065a9f816670 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:29.621833 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c4d342bf-f38a-4137-9b9a-065a9f816670 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1510 microversion: 2.1 time: 0.506244 Jul 25 08:48:29.625255 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 172/362] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:29 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1510 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:30.278528 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8c432a99-a453-417f-9815-44b5ea1e7b6e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:30.279835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8c432a99-a453-417f-9815-44b5ea1e7b6e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:30.296180 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c432a99-a453-417f-9815-44b5ea1e7b6e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:30.296760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c432a99-a453-417f-9815-44b5ea1e7b6e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:30.297540 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c432a99-a453-417f-9815-44b5ea1e7b6e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:30.306072 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c432a99-a453-417f-9815-44b5ea1e7b6e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:30.383486 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8c432a99-a453-417f-9815-44b5ea1e7b6e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:30.394800 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8c432a99-a453-417f-9815-44b5ea1e7b6e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:30.398968 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8c432a99-a453-417f-9815-44b5ea1e7b6e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:30.402469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8c432a99-a453-417f-9815-44b5ea1e7b6e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1286 microversion: 2.20 time: 0.126791 Jul 25 08:48:30.403733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 191/363] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:30 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:30.646298 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c2ded649-7ad4-4bfc-9707-53697f8957df tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:30.646990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c2ded649-7ad4-4bfc-9707-53697f8957df tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:30.653480 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c2ded649-7ad4-4bfc-9707-53697f8957df tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:30.653959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c2ded649-7ad4-4bfc-9707-53697f8957df tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:30.654726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c2ded649-7ad4-4bfc-9707-53697f8957df tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:30.655155 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c2ded649-7ad4-4bfc-9707-53697f8957df tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:30.813596 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c2ded649-7ad4-4bfc-9707-53697f8957df tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:30.821844 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c2ded649-7ad4-4bfc-9707-53697f8957df tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1510 microversion: 2.1 time: 0.179694 Jul 25 08:48:30.835383 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 173/364] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:30 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:31.430328 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aeb518b0-58d1-4cba-9782-816db8e86386 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:31.431656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-aeb518b0-58d1-4cba-9782-816db8e86386 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:31.438956 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aeb518b0-58d1-4cba-9782-816db8e86386 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:31.441735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aeb518b0-58d1-4cba-9782-816db8e86386 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:31.442812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aeb518b0-58d1-4cba-9782-816db8e86386 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:31.443492 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aeb518b0-58d1-4cba-9782-816db8e86386 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:31.557535 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-aeb518b0-58d1-4cba-9782-816db8e86386 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:31.567792 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-aeb518b0-58d1-4cba-9782-816db8e86386 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:31.569475 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-aeb518b0-58d1-4cba-9782-816db8e86386 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:31.570631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-aeb518b0-58d1-4cba-9782-816db8e86386 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1334 microversion: 2.20 time: 0.144150 Jul 25 08:48:31.571186 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 192/365] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:31 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1334 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:48:31.845863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c1e050a2-d3b9-43fa-808f-4cfffdc3daf3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:31.846486 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c1e050a2-d3b9-43fa-808f-4cfffdc3daf3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:31.859552 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c1e050a2-d3b9-43fa-808f-4cfffdc3daf3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:31.860015 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c1e050a2-d3b9-43fa-808f-4cfffdc3daf3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:31.860830 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c1e050a2-d3b9-43fa-808f-4cfffdc3daf3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:31.861268 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c1e050a2-d3b9-43fa-808f-4cfffdc3daf3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:32.486300 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c1e050a2-d3b9-43fa-808f-4cfffdc3daf3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:32.494430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c1e050a2-d3b9-43fa-808f-4cfffdc3daf3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1510 microversion: 2.1 time: 0.654169 Jul 25 08:48:32.495471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 174/366] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:31 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1510 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:32.593624 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4c774eca-6a31-4605-9b2c-ee9359cc6af3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:32.594237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4c774eca-6a31-4605-9b2c-ee9359cc6af3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:32.600813 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c774eca-6a31-4605-9b2c-ee9359cc6af3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:32.601271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c774eca-6a31-4605-9b2c-ee9359cc6af3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:32.602081 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c774eca-6a31-4605-9b2c-ee9359cc6af3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:32.602518 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c774eca-6a31-4605-9b2c-ee9359cc6af3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:32.684424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4c774eca-6a31-4605-9b2c-ee9359cc6af3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:32.693789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4c774eca-6a31-4605-9b2c-ee9359cc6af3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:32.695282 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4c774eca-6a31-4605-9b2c-ee9359cc6af3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:32.696384 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4c774eca-6a31-4605-9b2c-ee9359cc6af3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1334 microversion: 2.20 time: 0.106736 Jul 25 08:48:32.697038 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 193/367] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:32 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1334 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:33.518575 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c6197c4b-7b4f-47b4-a7b9-46ac97d24bda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:33.519412 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c6197c4b-7b4f-47b4-a7b9-46ac97d24bda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:33.529891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c6197c4b-7b4f-47b4-a7b9-46ac97d24bda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:33.538685 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c6197c4b-7b4f-47b4-a7b9-46ac97d24bda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:33.541990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c6197c4b-7b4f-47b4-a7b9-46ac97d24bda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:33.543782 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c6197c4b-7b4f-47b4-a7b9-46ac97d24bda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:33.736057 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bddd9ef6-7e54-4a8e-b5c3-4dd6fef1dd26 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:33.737994 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bddd9ef6-7e54-4a8e-b5c3-4dd6fef1dd26 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:33.760142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bddd9ef6-7e54-4a8e-b5c3-4dd6fef1dd26 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:33.761233 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bddd9ef6-7e54-4a8e-b5c3-4dd6fef1dd26 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:33.762421 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bddd9ef6-7e54-4a8e-b5c3-4dd6fef1dd26 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:33.763195 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bddd9ef6-7e54-4a8e-b5c3-4dd6fef1dd26 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:33.925565 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bddd9ef6-7e54-4a8e-b5c3-4dd6fef1dd26 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:33.940809 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bddd9ef6-7e54-4a8e-b5c3-4dd6fef1dd26 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:33.942820 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bddd9ef6-7e54-4a8e-b5c3-4dd6fef1dd26 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:33.944458 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bddd9ef6-7e54-4a8e-b5c3-4dd6fef1dd26 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1342 microversion: 2.20 time: 0.224578 Jul 25 08:48:33.946173 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 194/368] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:33 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1342 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:33.954403 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-23466427", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "networks": [{"uuid": "43d25711-c8fd-4bad-bbe1-48fae01c4a82"}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:34.139647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] validate_networks() for [('43d25711-c8fd-4bad-bbe1-48fae01c4a82', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:48:34.355466 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c6197c4b-7b4f-47b4-a7b9-46ac97d24bda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:34.376598 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c6197c4b-7b4f-47b4-a7b9-46ac97d24bda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1510 microversion: 2.1 time: 0.862169 Jul 25 08:48:34.377394 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 175/369] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:33 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1510 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:34.972007 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d1022629-4505-46e0-b349-e01f0147e57b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:34.973740 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d1022629-4505-46e0-b349-e01f0147e57b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:34.985896 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1022629-4505-46e0-b349-e01f0147e57b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:34.986592 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1022629-4505-46e0-b349-e01f0147e57b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:34.987530 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1022629-4505-46e0-b349-e01f0147e57b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:34.987959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1022629-4505-46e0-b349-e01f0147e57b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:35.335581 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d1022629-4505-46e0-b349-e01f0147e57b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:35.348362 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d1022629-4505-46e0-b349-e01f0147e57b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:35.353001 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d1022629-4505-46e0-b349-e01f0147e57b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:35.354512 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d1022629-4505-46e0-b349-e01f0147e57b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1340 microversion: 2.20 time: 0.387418 Jul 25 08:48:35.359042 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 176/370] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:34 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1340 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:48:35.402804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-082bf4c9-a497-41dc-b87c-6b64191df6fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:35.404221 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-082bf4c9-a497-41dc-b87c-6b64191df6fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:35.417988 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-082bf4c9-a497-41dc-b87c-6b64191df6fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:35.418740 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-082bf4c9-a497-41dc-b87c-6b64191df6fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:35.420428 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-082bf4c9-a497-41dc-b87c-6b64191df6fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:35.421074 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-082bf4c9-a497-41dc-b87c-6b64191df6fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:35.459838 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:48:35.460444 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:48:35.461072 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:48:35.461485 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:48:35.461888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:48:35.478562 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:35.483448 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:35.486403 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:35.491031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:35.560725 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Getting quotas for project 1e76bc803d784442936b25a7ad36d564. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:48:35.565430 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Getting quotas for user 316c65a9dcd8472ab10b532537e5dad7 and project 1e76bc803d784442936b25a7ad36d564. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:48:35.597415 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:48:35.600285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:48:35.725809 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bbbccb7f-9662-4861-bbb6-715665849dbb tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.775810 Jul 25 08:48:35.729679 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 195/371] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:48:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:48:35.741166 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bb7ad3a4-82fd-458b-9b54-61762147c6ff tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:35.742039 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bb7ad3a4-82fd-458b-9b54-61762147c6ff tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:36.335492 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-082bf4c9-a497-41dc-b87c-6b64191df6fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:36.349315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bb7ad3a4-82fd-458b-9b54-61762147c6ff tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:36.358192 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bb7ad3a4-82fd-458b-9b54-61762147c6ff tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1217 microversion: 2.1 time: 0.621688 Jul 25 08:48:36.366218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-082bf4c9-a497-41dc-b87c-6b64191df6fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1516 microversion: 2.1 time: 0.967705 Jul 25 08:48:36.367386 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 196/372] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:35 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1217 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:36.400945 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 177/373] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:35 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1516 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:36.410102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-762eb54e-9b7e-4673-9ecd-15597fabe339 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:36.410617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-762eb54e-9b7e-4673-9ecd-15597fabe339 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:36.420459 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-762eb54e-9b7e-4673-9ecd-15597fabe339 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:36.435742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-762eb54e-9b7e-4673-9ecd-15597fabe339 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:36.436653 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-762eb54e-9b7e-4673-9ecd-15597fabe339 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:36.437107 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-762eb54e-9b7e-4673-9ecd-15597fabe339 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:37.392505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-db0e904d-f5af-46d1-a5ba-47bfef9b3806 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:37.393274 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-db0e904d-f5af-46d1-a5ba-47bfef9b3806 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:37.420240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-db0e904d-f5af-46d1-a5ba-47bfef9b3806 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:37.424591 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-db0e904d-f5af-46d1-a5ba-47bfef9b3806 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:37.425682 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-db0e904d-f5af-46d1-a5ba-47bfef9b3806 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:37.433167 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-db0e904d-f5af-46d1-a5ba-47bfef9b3806 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:37.749648 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-db0e904d-f5af-46d1-a5ba-47bfef9b3806 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:37.764150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-db0e904d-f5af-46d1-a5ba-47bfef9b3806 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1269 microversion: 2.1 time: 0.375137 Jul 25 08:48:37.767977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 178/374] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:37 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1269 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:37.783717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-762eb54e-9b7e-4673-9ecd-15597fabe339 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:37.792054 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-762eb54e-9b7e-4673-9ecd-15597fabe339 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:37.799511 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-762eb54e-9b7e-4673-9ecd-15597fabe339 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:37.801068 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-762eb54e-9b7e-4673-9ecd-15597fabe339 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 1.404451 Jul 25 08:48:37.824330 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 197/375] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:36 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:38.458618 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a9b36001-c1c4-4f3c-a525-a821633824fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'create', calling method: .version_select at 0x7f0f79be2700>, body: {"keypair": {"name": "tempest-keypair-1824151767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNu9E+i8f4eTc40nqFcImT1B7HmBkKGzEcdZhV34h8wv56bfF5ERHd/s1KmQ7ZkYwhmgyUcUyBKEHuWeeFJ9QzH+XlmDuJWmdlk5T5WnP4tdADWv8GVg/PDNhy3gaHeTqA=="}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:38.533376 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-a9b36001-c1c4-4f3c-a525-a821633824fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Getting quotas for project 7e61cbb537384f549eee9ec4c92d9d77. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:48:38.553523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-a9b36001-c1c4-4f3c-a525-a821633824fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Getting quotas for user 238f78244df546e5a6fc1a4cd1b73288 and project 7e61cbb537384f549eee9ec4c92d9d77. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:48:38.665381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a9b36001-c1c4-4f3c-a525-a821633824fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.219242 Jul 25 08:48:38.670182 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-b53fc022-ee04-4d3d-89d0-02bffa7045ab req-1de52be8-8641-4210-8275-1b0de8c0e47c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4a347c-82ac-48e1-a31e-45f7eb643cda", "tag": "8fcdc018-b6d0-4c78-ac99-e89933f5caf7"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:38.679103 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 179/376] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Jul 25 08:48:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:48:38.706845 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-b53fc022-ee04-4d3d-89d0-02bffa7045ab req-1de52be8-8641-4210-8275-1b0de8c0e47c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:38.713938 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-b53fc022-ee04-4d3d-89d0-02bffa7045ab req-1de52be8-8641-4210-8275-1b0de8c0e47c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:38.755044 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-b53fc022-ee04-4d3d-89d0-02bffa7045ab req-1de52be8-8641-4210-8275-1b0de8c0e47c service nova] Creating event network-changed:8fcdc018-b6d0-4c78-ac99-e89933f5caf7 for instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda on hv-cinder-85084 Jul 25 08:48:38.770339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-b53fc022-ee04-4d3d-89d0-02bffa7045ab req-1de52be8-8641-4210-8275-1b0de8c0e47c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099502 Jul 25 08:48:38.774286 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 198/377] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:48:38.787858 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dcfedd89-78fc-445b-ac39-163e73ea46a2 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:38.788491 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dcfedd89-78fc-445b-ac39-163e73ea46a2 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:38.805954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcfedd89-78fc-445b-ac39-163e73ea46a2 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:38.806416 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcfedd89-78fc-445b-ac39-163e73ea46a2 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:38.807212 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcfedd89-78fc-445b-ac39-163e73ea46a2 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:38.807652 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcfedd89-78fc-445b-ac39-163e73ea46a2 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:38.839717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-60ea2b24-94af-4467-a304-fe7ca5a57530 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:38.840427 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-60ea2b24-94af-4467-a304-fe7ca5a57530 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:38.856187 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60ea2b24-94af-4467-a304-fe7ca5a57530 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:38.857395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60ea2b24-94af-4467-a304-fe7ca5a57530 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:38.858333 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60ea2b24-94af-4467-a304-fe7ca5a57530 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:38.858769 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60ea2b24-94af-4467-a304-fe7ca5a57530 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:38.931450 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:39.366361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dcfedd89-78fc-445b-ac39-163e73ea46a2 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:39.375779 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dcfedd89-78fc-445b-ac39-163e73ea46a2 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1275 microversion: 2.1 time: 0.593212 Jul 25 08:48:39.377849 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 180/378] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:38 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1275 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:39.828726 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-60ea2b24-94af-4467-a304-fe7ca5a57530 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:39.850122 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-60ea2b24-94af-4467-a304-fe7ca5a57530 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:39.854231 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-60ea2b24-94af-4467-a304-fe7ca5a57530 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:39.860248 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-60ea2b24-94af-4467-a304-fe7ca5a57530 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 1.030136 Jul 25 08:48:39.861574 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 199/379] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:38 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:48:40.405756 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f8adfb5a-2333-4916-8800-3603f47d38d4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:40.406471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f8adfb5a-2333-4916-8800-3603f47d38d4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:40.418011 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8adfb5a-2333-4916-8800-3603f47d38d4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:40.419482 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8adfb5a-2333-4916-8800-3603f47d38d4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:40.421516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8adfb5a-2333-4916-8800-3603f47d38d4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:40.424025 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8adfb5a-2333-4916-8800-3603f47d38d4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:40.602659 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f8adfb5a-2333-4916-8800-3603f47d38d4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:40.640005 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f8adfb5a-2333-4916-8800-3603f47d38d4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1275 microversion: 2.1 time: 0.238683 Jul 25 08:48:40.644493 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 181/380] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:40 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:40.891834 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0f5ab3a3-066e-4b38-9119-2c0146cb9ab8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:40.892593 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0f5ab3a3-066e-4b38-9119-2c0146cb9ab8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:40.902122 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:40.917546 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f5ab3a3-066e-4b38-9119-2c0146cb9ab8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:40.920003 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f5ab3a3-066e-4b38-9119-2c0146cb9ab8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:40.922331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f5ab3a3-066e-4b38-9119-2c0146cb9ab8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:40.923504 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f5ab3a3-066e-4b38-9119-2c0146cb9ab8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:41.268672 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0f5ab3a3-066e-4b38-9119-2c0146cb9ab8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:41.304159 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0f5ab3a3-066e-4b38-9119-2c0146cb9ab8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:41.315932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0f5ab3a3-066e-4b38-9119-2c0146cb9ab8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:41.323709 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0f5ab3a3-066e-4b38-9119-2c0146cb9ab8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 0.438698 Jul 25 08:48:41.327140 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 200/381] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:40 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:41.667589 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1881fb78-1dde-4df2-b6fa-ea14601b6cce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:41.668755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1881fb78-1dde-4df2-b6fa-ea14601b6cce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:41.691665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1881fb78-1dde-4df2-b6fa-ea14601b6cce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:41.698607 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1881fb78-1dde-4df2-b6fa-ea14601b6cce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:41.699545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1881fb78-1dde-4df2-b6fa-ea14601b6cce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:41.700003 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1881fb78-1dde-4df2-b6fa-ea14601b6cce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:42.074153 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1881fb78-1dde-4df2-b6fa-ea14601b6cce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:42.090542 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1881fb78-1dde-4df2-b6fa-ea14601b6cce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.429948 Jul 25 08:48:42.091883 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 182/382] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:41 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:42.351227 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4af53f78-4d59-44af-9707-bbf5249beecf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:42.357812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4af53f78-4d59-44af-9707-bbf5249beecf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:42.384777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4af53f78-4d59-44af-9707-bbf5249beecf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:42.385699 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4af53f78-4d59-44af-9707-bbf5249beecf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:42.389591 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4af53f78-4d59-44af-9707-bbf5249beecf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:42.391054 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4af53f78-4d59-44af-9707-bbf5249beecf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:42.716051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4af53f78-4d59-44af-9707-bbf5249beecf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:42.724051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4af53f78-4d59-44af-9707-bbf5249beecf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:42.733699 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4af53f78-4d59-44af-9707-bbf5249beecf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:42.735141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4af53f78-4d59-44af-9707-bbf5249beecf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 0.388759 Jul 25 08:48:42.737615 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 201/383] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:42 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:43.112515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4a75c707-4119-40a5-93ed-62ab33e74492 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:43.113171 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4a75c707-4119-40a5-93ed-62ab33e74492 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:43.142482 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4a75c707-4119-40a5-93ed-62ab33e74492 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:43.144041 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4a75c707-4119-40a5-93ed-62ab33e74492 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:43.145634 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4a75c707-4119-40a5-93ed-62ab33e74492 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:43.146680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4a75c707-4119-40a5-93ed-62ab33e74492 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:43.562656 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4a75c707-4119-40a5-93ed-62ab33e74492 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:43.573833 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4a75c707-4119-40a5-93ed-62ab33e74492 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.465728 Jul 25 08:48:43.578394 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 183/384] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:43 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:43.760881 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-244f3472-dffb-40a6-98f9-e14fc1d72ae4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:43.762232 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-244f3472-dffb-40a6-98f9-e14fc1d72ae4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:43.782588 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-244f3472-dffb-40a6-98f9-e14fc1d72ae4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:43.786798 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-244f3472-dffb-40a6-98f9-e14fc1d72ae4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:43.787920 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-244f3472-dffb-40a6-98f9-e14fc1d72ae4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:43.788556 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-244f3472-dffb-40a6-98f9-e14fc1d72ae4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:44.086434 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1075930943", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d9d4ebf-a640-4736-9377-d7ebfc6f53b2"}], "security_groups": [{"name": "tempest-securitygroup--889131366"}], "key_name": "tempest-keypair-1824151767", "user_data": "}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:44.294005 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-244f3472-dffb-40a6-98f9-e14fc1d72ae4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:44.322056 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-244f3472-dffb-40a6-98f9-e14fc1d72ae4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:44.324028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-244f3472-dffb-40a6-98f9-e14fc1d72ae4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:44.335980 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-244f3472-dffb-40a6-98f9-e14fc1d72ae4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 0.579920 Jul 25 08:48:44.341563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 202/385] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:43 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:44.599233 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-74bc2d3e-f9a3-480d-8de5-f5ae642a3711 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:44.600164 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-74bc2d3e-f9a3-480d-8de5-f5ae642a3711 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:44.621207 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-74bc2d3e-f9a3-480d-8de5-f5ae642a3711 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:44.622152 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-74bc2d3e-f9a3-480d-8de5-f5ae642a3711 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:44.624772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-74bc2d3e-f9a3-480d-8de5-f5ae642a3711 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:44.636022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-74bc2d3e-f9a3-480d-8de5-f5ae642a3711 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:45.410632 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-74bc2d3e-f9a3-480d-8de5-f5ae642a3711 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:45.428441 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-74bc2d3e-f9a3-480d-8de5-f5ae642a3711 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.833567 Jul 25 08:48:45.436087 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 203/386] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:44 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:45.479202 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-885cce83-881c-43e4-8d02-398a56d042bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:45.491084 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-885cce83-881c-43e4-8d02-398a56d042bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:45.500305 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-885cce83-881c-43e4-8d02-398a56d042bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:45.500785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-885cce83-881c-43e4-8d02-398a56d042bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:45.501628 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-885cce83-881c-43e4-8d02-398a56d042bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:45.502060 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-885cce83-881c-43e4-8d02-398a56d042bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:45.522651 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:45.839911 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-885cce83-881c-43e4-8d02-398a56d042bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:45.853214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-885cce83-881c-43e4-8d02-398a56d042bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:45.856243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-885cce83-881c-43e4-8d02-398a56d042bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:45.868326 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-885cce83-881c-43e4-8d02-398a56d042bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 0.429690 Jul 25 08:48:45.870962 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 204/387] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:45 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:45.877603 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-29ccbd59-9c9d-440f-82ca-1d20f38eef40 req-2fbd5c11-6fff-4d11-865d-641269190b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c617f8-5881-4ef1-a9d2-2031c4cb3530", "tag": "a890aaec-1df4-4858-be7e-3764009f17a4"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:45.899279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-29ccbd59-9c9d-440f-82ca-1d20f38eef40 req-2fbd5c11-6fff-4d11-865d-641269190b60 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:45.899706 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-29ccbd59-9c9d-440f-82ca-1d20f38eef40 req-2fbd5c11-6fff-4d11-865d-641269190b60 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:45.938374 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-29ccbd59-9c9d-440f-82ca-1d20f38eef40 req-2fbd5c11-6fff-4d11-865d-641269190b60 service nova] Creating event network-changed:a890aaec-1df4-4858-be7e-3764009f17a4 for instance 51c617f8-5881-4ef1-a9d2-2031c4cb3530 on hv-cinder-85084 Jul 25 08:48:45.948392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-29ccbd59-9c9d-440f-82ca-1d20f38eef40 req-2fbd5c11-6fff-4d11-865d-641269190b60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074294 Jul 25 08:48:45.949315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 205/388] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:48:46.461091 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-923395d8-5dc0-4e30-81d3-3260e5631b75 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:46.461867 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-923395d8-5dc0-4e30-81d3-3260e5631b75 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:46.463948 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=14 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:46.494007 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-923395d8-5dc0-4e30-81d3-3260e5631b75 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:46.494576 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-923395d8-5dc0-4e30-81d3-3260e5631b75 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:46.496641 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-923395d8-5dc0-4e30-81d3-3260e5631b75 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:46.500259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-923395d8-5dc0-4e30-81d3-3260e5631b75 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:46.865946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-923395d8-5dc0-4e30-81d3-3260e5631b75 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:46.881431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-923395d8-5dc0-4e30-81d3-3260e5631b75 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.425644 Jul 25 08:48:46.897064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 206/389] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:46 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:46.905836 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-103cdb8a-d577-4b6b-9e43-8b6b3f4ab007 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:46.910906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-103cdb8a-d577-4b6b-9e43-8b6b3f4ab007 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:46.936903 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-103cdb8a-d577-4b6b-9e43-8b6b3f4ab007 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:46.937366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-103cdb8a-d577-4b6b-9e43-8b6b3f4ab007 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:46.938165 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-103cdb8a-d577-4b6b-9e43-8b6b3f4ab007 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:46.938773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-103cdb8a-d577-4b6b-9e43-8b6b3f4ab007 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:47.308320 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-103cdb8a-d577-4b6b-9e43-8b6b3f4ab007 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:47.321986 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-103cdb8a-d577-4b6b-9e43-8b6b3f4ab007 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:47.324001 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-103cdb8a-d577-4b6b-9e43-8b6b3f4ab007 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:47.327991 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-103cdb8a-d577-4b6b-9e43-8b6b3f4ab007 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 0.429479 Jul 25 08:48:47.341523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 207/390] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:46 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:47.904429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-de284b43-e518-4a5f-87e2-838d387937e3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:47.905867 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-de284b43-e518-4a5f-87e2-838d387937e3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:47.919559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de284b43-e518-4a5f-87e2-838d387937e3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:47.923943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de284b43-e518-4a5f-87e2-838d387937e3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:47.925257 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de284b43-e518-4a5f-87e2-838d387937e3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:47.925864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de284b43-e518-4a5f-87e2-838d387937e3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:48.242017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-de284b43-e518-4a5f-87e2-838d387937e3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:48.250492 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-de284b43-e518-4a5f-87e2-838d387937e3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.350644 Jul 25 08:48:48.261731 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 208/391] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:47 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:48.266898 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-92d16a80-695d-412e-a3e8-abf5822f40c1 req-8768070a-b1c3-40ae-ba72-2a048ba21620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4a347c-82ac-48e1-a31e-45f7eb643cda", "name": "network-vif-plugged", "status": "completed", "tag": "8fcdc018-b6d0-4c78-ac99-e89933f5caf7"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:48.300187 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-92d16a80-695d-412e-a3e8-abf5822f40c1 req-8768070a-b1c3-40ae-ba72-2a048ba21620 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:48.300753 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-92d16a80-695d-412e-a3e8-abf5822f40c1 req-8768070a-b1c3-40ae-ba72-2a048ba21620 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:48.322517 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-92d16a80-695d-412e-a3e8-abf5822f40c1 req-8768070a-b1c3-40ae-ba72-2a048ba21620 service nova] Creating event network-vif-plugged:8fcdc018-b6d0-4c78-ac99-e89933f5caf7 for instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda on hv-cinder-85084 Jul 25 08:48:48.329333 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-92d16a80-695d-412e-a3e8-abf5822f40c1 req-8768070a-b1c3-40ae-ba72-2a048ba21620 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066465 Jul 25 08:48:48.332900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 209/392] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:48:48.356262 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f8e5a3d8-4e27-4333-882e-dcc9964ac00a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:48.357070 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f8e5a3d8-4e27-4333-882e-dcc9964ac00a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:48.374163 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f8e5a3d8-4e27-4333-882e-dcc9964ac00a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:48.374609 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f8e5a3d8-4e27-4333-882e-dcc9964ac00a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:48.375396 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f8e5a3d8-4e27-4333-882e-dcc9964ac00a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:48.375824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f8e5a3d8-4e27-4333-882e-dcc9964ac00a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:48.602179 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=10 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:48.721877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f8e5a3d8-4e27-4333-882e-dcc9964ac00a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:48.730988 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f8e5a3d8-4e27-4333-882e-dcc9964ac00a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:48.732540 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f8e5a3d8-4e27-4333-882e-dcc9964ac00a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:48.750480 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f8e5a3d8-4e27-4333-882e-dcc9964ac00a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 0.382101 Jul 25 08:48:48.751672 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 210/393] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:48 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:49.274524 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-182487ff-bac6-42c6-b2e5-99a49f5ccfc1 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:49.276038 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-182487ff-bac6-42c6-b2e5-99a49f5ccfc1 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:49.283436 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-182487ff-bac6-42c6-b2e5-99a49f5ccfc1 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:49.284212 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-182487ff-bac6-42c6-b2e5-99a49f5ccfc1 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:49.285249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-182487ff-bac6-42c6-b2e5-99a49f5ccfc1 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:49.285895 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-182487ff-bac6-42c6-b2e5-99a49f5ccfc1 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:49.288951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:49.537207 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-182487ff-bac6-42c6-b2e5-99a49f5ccfc1 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:49.547114 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-182487ff-bac6-42c6-b2e5-99a49f5ccfc1 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.276527 Jul 25 08:48:49.553002 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 211/394] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:49 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:49.776027 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-63165ebc-6fcd-42c6-be09-49d5294ec9ec tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:49.777168 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-63165ebc-6fcd-42c6-be09-49d5294ec9ec tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:49.789801 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-63165ebc-6fcd-42c6-be09-49d5294ec9ec tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:49.790612 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-63165ebc-6fcd-42c6-be09-49d5294ec9ec tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:49.791783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-63165ebc-6fcd-42c6-be09-49d5294ec9ec tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:49.792428 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-63165ebc-6fcd-42c6-be09-49d5294ec9ec tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:49.962175 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-63165ebc-6fcd-42c6-be09-49d5294ec9ec tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:50.015964 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-63165ebc-6fcd-42c6-be09-49d5294ec9ec tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:50.018012 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-63165ebc-6fcd-42c6-be09-49d5294ec9ec tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:50.019259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-63165ebc-6fcd-42c6-be09-49d5294ec9ec tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 0.247084 Jul 25 08:48:50.028690 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 212/395] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:49 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:48:50.572982 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b93c7fc1-3c76-49d4-b20e-15cb8b16fbae tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:50.573684 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b93c7fc1-3c76-49d4-b20e-15cb8b16fbae tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:50.591362 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b93c7fc1-3c76-49d4-b20e-15cb8b16fbae tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:50.591362 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b93c7fc1-3c76-49d4-b20e-15cb8b16fbae tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:50.592191 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b93c7fc1-3c76-49d4-b20e-15cb8b16fbae tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:50.592825 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b93c7fc1-3c76-49d4-b20e-15cb8b16fbae tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:50.806767 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b93c7fc1-3c76-49d4-b20e-15cb8b16fbae tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:50.824076 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b93c7fc1-3c76-49d4-b20e-15cb8b16fbae tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.260108 Jul 25 08:48:50.824980 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 213/396] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:50 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:51.063813 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9503f959-1e82-4e1e-83aa-4ec4d33db32a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:51.064436 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9503f959-1e82-4e1e-83aa-4ec4d33db32a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:51.077322 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9503f959-1e82-4e1e-83aa-4ec4d33db32a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:51.077693 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9503f959-1e82-4e1e-83aa-4ec4d33db32a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:51.078509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9503f959-1e82-4e1e-83aa-4ec4d33db32a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:51.078942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9503f959-1e82-4e1e-83aa-4ec4d33db32a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:51.299629 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9503f959-1e82-4e1e-83aa-4ec4d33db32a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:51.332352 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9503f959-1e82-4e1e-83aa-4ec4d33db32a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:51.335198 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9503f959-1e82-4e1e-83aa-4ec4d33db32a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:51.349832 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9503f959-1e82-4e1e-83aa-4ec4d33db32a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 0.276761 Jul 25 08:48:51.351136 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 214/397] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:51 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:51.849453 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1ebca2c7-6cbd-4c08-b86d-2450dc5d1f71 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:51.850851 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1ebca2c7-6cbd-4c08-b86d-2450dc5d1f71 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:51.879763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ebca2c7-6cbd-4c08-b86d-2450dc5d1f71 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:51.879763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ebca2c7-6cbd-4c08-b86d-2450dc5d1f71 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:51.879763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ebca2c7-6cbd-4c08-b86d-2450dc5d1f71 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:51.879763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ebca2c7-6cbd-4c08-b86d-2450dc5d1f71 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:52.174267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1ebca2c7-6cbd-4c08-b86d-2450dc5d1f71 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:52.184293 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1ebca2c7-6cbd-4c08-b86d-2450dc5d1f71 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.338971 Jul 25 08:48:52.184911 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 215/398] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:51 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:52.383937 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-173996db-3bfd-4da0-936f-db7321daa6f9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:52.384466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-173996db-3bfd-4da0-936f-db7321daa6f9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:52.391886 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-173996db-3bfd-4da0-936f-db7321daa6f9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:52.392338 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-173996db-3bfd-4da0-936f-db7321daa6f9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:52.393158 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-173996db-3bfd-4da0-936f-db7321daa6f9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:52.393600 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-173996db-3bfd-4da0-936f-db7321daa6f9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:52.649379 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-173996db-3bfd-4da0-936f-db7321daa6f9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:52.659219 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-173996db-3bfd-4da0-936f-db7321daa6f9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:52.669960 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-173996db-3bfd-4da0-936f-db7321daa6f9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:52.671128 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-173996db-3bfd-4da0-936f-db7321daa6f9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 0.291636 Jul 25 08:48:52.672137 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 216/399] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:52 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:53.220138 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-77d7c19f-c427-495b-a17b-44c78b5eb153 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:53.221318 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-77d7c19f-c427-495b-a17b-44c78b5eb153 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:53.258636 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77d7c19f-c427-495b-a17b-44c78b5eb153 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:53.259088 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77d7c19f-c427-495b-a17b-44c78b5eb153 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:53.259867 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77d7c19f-c427-495b-a17b-44c78b5eb153 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:53.261117 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77d7c19f-c427-495b-a17b-44c78b5eb153 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:53.495373 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-77d7c19f-c427-495b-a17b-44c78b5eb153 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:53.505749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-77d7c19f-c427-495b-a17b-44c78b5eb153 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.289854 Jul 25 08:48:53.506340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 217/400] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:53 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:53.570761 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=94 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:53.701812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-635f1c0b-b7fe-497e-b326-a05484f384e3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:53.702469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-635f1c0b-b7fe-497e-b326-a05484f384e3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:53.709309 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-635f1c0b-b7fe-497e-b326-a05484f384e3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:53.712460 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-635f1c0b-b7fe-497e-b326-a05484f384e3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:53.713603 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-635f1c0b-b7fe-497e-b326-a05484f384e3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:53.714242 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-635f1c0b-b7fe-497e-b326-a05484f384e3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:54.115014 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:54.305006 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-635f1c0b-b7fe-497e-b326-a05484f384e3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:54.318761 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-635f1c0b-b7fe-497e-b326-a05484f384e3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:54.320599 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-635f1c0b-b7fe-497e-b326-a05484f384e3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:54.321822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-635f1c0b-b7fe-497e-b326-a05484f384e3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1407 microversion: 2.20 time: 0.625874 Jul 25 08:48:54.328781 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 218/401] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:53 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1407 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:54.531817 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-955cc781-200b-4b37-89de-2d75b1a59f29 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:54.532877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-955cc781-200b-4b37-89de-2d75b1a59f29 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:54.539472 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-955cc781-200b-4b37-89de-2d75b1a59f29 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:54.549566 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-955cc781-200b-4b37-89de-2d75b1a59f29 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:54.550423 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-955cc781-200b-4b37-89de-2d75b1a59f29 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:54.550946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-955cc781-200b-4b37-89de-2d75b1a59f29 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:54.764267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-955cc781-200b-4b37-89de-2d75b1a59f29 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:54.772381 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-955cc781-200b-4b37-89de-2d75b1a59f29 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.249307 Jul 25 08:48:54.785434 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 219/402] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:54 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:48:55.376625 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-53fc7572-b55c-4c23-8333-8bb21b62fe8b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:55.376625 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-53fc7572-b55c-4c23-8333-8bb21b62fe8b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:55.376625 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53fc7572-b55c-4c23-8333-8bb21b62fe8b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:55.376625 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53fc7572-b55c-4c23-8333-8bb21b62fe8b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:55.377598 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53fc7572-b55c-4c23-8333-8bb21b62fe8b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:55.377598 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53fc7572-b55c-4c23-8333-8bb21b62fe8b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:55.549669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-53fc7572-b55c-4c23-8333-8bb21b62fe8b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:55.558684 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-53fc7572-b55c-4c23-8333-8bb21b62fe8b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:55.561020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-53fc7572-b55c-4c23-8333-8bb21b62fe8b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:55.562196 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-53fc7572-b55c-4c23-8333-8bb21b62fe8b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1600 microversion: 2.20 time: 0.217592 Jul 25 08:48:55.563420 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 220/403] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:48:55 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:48:55.595558 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b5919cc1-9a65-4032-97f4-47d532565972 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:55.596016 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b5919cc1-9a65-4032-97f4-47d532565972 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:55.607214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5919cc1-9a65-4032-97f4-47d532565972 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:55.607675 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5919cc1-9a65-4032-97f4-47d532565972 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:55.610614 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5919cc1-9a65-4032-97f4-47d532565972 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:55.611069 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5919cc1-9a65-4032-97f4-47d532565972 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:55.771241 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b5919cc1-9a65-4032-97f4-47d532565972 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.180066 Jul 25 08:48:55.772029 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 221/404] 10.222.0.52 () {60 vars in 1316 bytes} [Mon Jul 25 08:48:55 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:48:55.796679 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8655e822-5b43-4296-a686-bbfb09c08f1f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:55.797562 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8655e822-5b43-4296-a686-bbfb09c08f1f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:55.817529 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8655e822-5b43-4296-a686-bbfb09c08f1f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:55.817988 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8655e822-5b43-4296-a686-bbfb09c08f1f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:55.818763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8655e822-5b43-4296-a686-bbfb09c08f1f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:55.819201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8655e822-5b43-4296-a686-bbfb09c08f1f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:56.397635 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8655e822-5b43-4296-a686-bbfb09c08f1f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:56.405089 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8655e822-5b43-4296-a686-bbfb09c08f1f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.615545 Jul 25 08:48:56.405656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 222/405] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:55 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:56.422386 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ab2605ee-fc59-4308-975d-0e5eef277cbc tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Action: 'create', calling method: .version_select at 0x7f0f79bd1310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1650024625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEvPfg8cMvHvTPN/NrD9C7nv+3LtfP2F1zop4mv61e+rh3wX1wKyV039oDD7zYhQGGi5lEBEgIkhYnJzZxGYsYzcH7YRVKNBbHeU03bvbzGk1LmHsQcFWGZvNoapu1fQg=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:56.449312 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-ab2605ee-fc59-4308-975d-0e5eef277cbc tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Getting quotas for project 3404b1a99987401183c8e3e851b382db. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:48:56.453893 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-ab2605ee-fc59-4308-975d-0e5eef277cbc tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Getting quotas for user cd036c73e5c84fa1ba548be4eae80804 and project 3404b1a99987401183c8e3e851b382db. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:48:56.490507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ab2605ee-fc59-4308-975d-0e5eef277cbc tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.080244 Jul 25 08:48:56.491120 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 223/406] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Jul 25 08:48:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:48:56.514402 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.network.neutron [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] validate_networks() for [('2d9d4ebf-a640-4736-9377-d7ebfc6f53b2', None, None, None, None, None)] {{(pid=124234) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:48:56.589552 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1774330053", "imageRef": "2598357c-d149-4983-9061-078c1fa42409", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1650024625", "networks": [{"uuid": "5fca7c14-bb96-4e04-b288-c4911dc494c5"}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:56.702487 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] validate_networks() for [('5fca7c14-bb96-4e04-b288-c4911dc494c5', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:48:57.664947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Flavor limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:48:57.666076 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Image limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:48:57.666750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Flavor pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:48:57.667340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Image pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:48:57.668476 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:48:57.689700 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:57.690586 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:57.691549 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:57.692155 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:57.719701 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:48:57.720188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:48:57.720693 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:48:57.721028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:48:57.723157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:48:57.731877 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Getting quotas for project 7e61cbb537384f549eee9ec4c92d9d77. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:48:57.739429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:57.740218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:57.741261 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:57.741552 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Getting quotas for user 238f78244df546e5a6fc1a4cd1b73288 and project 7e61cbb537384f549eee9ec4c92d9d77. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:48:57.742138 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:57.768992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Getting quotas for project 3404b1a99987401183c8e3e851b382db. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:48:57.770582 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Going to run 1 instances... {{(pid=124234) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:48:57.776635 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Getting quotas for user cd036c73e5c84fa1ba548be4eae80804 and project 3404b1a99987401183c8e3e851b382db. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:48:57.791605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124234) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:48:57.791884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:48:57.794870 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2598357c-d149-4983-9061-078c1fa42409',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:48:57.862999 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-921e1d87-758b-46f4-88ce-22dbd0d4ae72 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 13.782475 Jul 25 08:48:57.863946 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 184/407] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:48:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 13785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:48:57.876431 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-7fa3a775-ec3f-4078-bc4b-93396803a5af req-0a233db6-a792-4cc5-9317-73317022ba1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c617f8-5881-4ef1-a9d2-2031c4cb3530", "name": "network-vif-plugged", "status": "completed", "tag": "a890aaec-1df4-4858-be7e-3764009f17a4"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:57.880867 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-19056c1d-2c8a-406f-9e73-b8ee823face0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305005 Jul 25 08:48:57.881530 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 224/408] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:48:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 08:48:57.895288 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-af8e00f6-1962-4801-8f64-ec3b981b7bd3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:57.904902 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-af8e00f6-1962-4801-8f64-ec3b981b7bd3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:57.928107 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af8e00f6-1962-4801-8f64-ec3b981b7bd3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:57.928595 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af8e00f6-1962-4801-8f64-ec3b981b7bd3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:57.929393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af8e00f6-1962-4801-8f64-ec3b981b7bd3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:57.929832 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af8e00f6-1962-4801-8f64-ec3b981b7bd3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:57.943401 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-7fa3a775-ec3f-4078-bc4b-93396803a5af req-0a233db6-a792-4cc5-9317-73317022ba1c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:57.949323 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-7fa3a775-ec3f-4078-bc4b-93396803a5af req-0a233db6-a792-4cc5-9317-73317022ba1c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:57.985703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-7fa3a775-ec3f-4078-bc4b-93396803a5af req-0a233db6-a792-4cc5-9317-73317022ba1c service nova] Creating event network-vif-plugged:a890aaec-1df4-4858-be7e-3764009f17a4 for instance 51c617f8-5881-4ef1-a9d2-2031c4cb3530 on hv-cinder-85084 Jul 25 08:48:58.001416 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-7fa3a775-ec3f-4078-bc4b-93396803a5af req-0a233db6-a792-4cc5-9317-73317022ba1c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129013 Jul 25 08:48:58.002878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 185/409] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:48:58.027122 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3d0f9ae5-26bc-4544-8ca9-efcd43e64f25 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:58.030358 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3d0f9ae5-26bc-4544-8ca9-efcd43e64f25 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:58.279899 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3d0f9ae5-26bc-4544-8ca9-efcd43e64f25 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:58.287667 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3d0f9ae5-26bc-4544-8ca9-efcd43e64f25 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1246 microversion: 2.1 time: 0.282970 Jul 25 08:48:58.299508 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 186/410] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:58 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1246 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:58.316979 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ffd038b4-9fbc-499a-bd1b-345d650b2fe1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:58.317675 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ffd038b4-9fbc-499a-bd1b-345d650b2fe1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:58.447709 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ffd038b4-9fbc-499a-bd1b-345d650b2fe1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:58.449146 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ffd038b4-9fbc-499a-bd1b-345d650b2fe1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1259 microversion: 2.1 time: 0.146305 Jul 25 08:48:58.454110 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 187/411] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:58 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:58.479273 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-af8e00f6-1962-4801-8f64-ec3b981b7bd3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:58.491856 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-af8e00f6-1962-4801-8f64-ec3b981b7bd3 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.609052 Jul 25 08:48:58.504607 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 225/412] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:57 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:58.527520 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-ba19ea25-58f2-4b3b-b33b-d0b3271c1a1d req-5f6e5e61-47f3-48ca-b40b-41242abbef0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4a347c-82ac-48e1-a31e-45f7eb643cda", "tag": "8fcdc018-b6d0-4c78-ac99-e89933f5caf7"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:48:58.540481 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-ba19ea25-58f2-4b3b-b33b-d0b3271c1a1d req-5f6e5e61-47f3-48ca-b40b-41242abbef0e service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:58.541600 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-ba19ea25-58f2-4b3b-b33b-d0b3271c1a1d req-5f6e5e61-47f3-48ca-b40b-41242abbef0e service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:58.557841 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-ba19ea25-58f2-4b3b-b33b-d0b3271c1a1d req-5f6e5e61-47f3-48ca-b40b-41242abbef0e service nova] Creating event network-changed:8fcdc018-b6d0-4c78-ac99-e89933f5caf7 for instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda on hv-cinder-85084 Jul 25 08:48:58.564123 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-ba19ea25-58f2-4b3b-b33b-d0b3271c1a1d req-5f6e5e61-47f3-48ca-b40b-41242abbef0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040399 Jul 25 08:48:58.565063 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 188/413] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:48:59.324601 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9d14cd07-98d2-42aa-8220-241af475d538 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:59.325717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9d14cd07-98d2-42aa-8220-241af475d538 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:59.331984 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d14cd07-98d2-42aa-8220-241af475d538 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:59.332667 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d14cd07-98d2-42aa-8220-241af475d538 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:59.333440 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d14cd07-98d2-42aa-8220-241af475d538 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:59.333879 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d14cd07-98d2-42aa-8220-241af475d538 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:59.400979 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9d14cd07-98d2-42aa-8220-241af475d538 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:59.409381 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9d14cd07-98d2-42aa-8220-241af475d538 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1250 microversion: 2.1 time: 0.088650 Jul 25 08:48:59.410213 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 226/414] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:59 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:59.477882 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-16edd28c-544c-453f-813a-3115eb111a6a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:59.478491 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-16edd28c-544c-453f-813a-3115eb111a6a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:59.488152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-16edd28c-544c-453f-813a-3115eb111a6a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:59.488627 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-16edd28c-544c-453f-813a-3115eb111a6a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:59.489596 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-16edd28c-544c-453f-813a-3115eb111a6a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:59.490083 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-16edd28c-544c-453f-813a-3115eb111a6a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:59.518368 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e5b67e7c-9b62-4a2a-8333-7bc83d7a62b4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:48:59.518988 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e5b67e7c-9b62-4a2a-8333-7bc83d7a62b4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:48:59.530657 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5b67e7c-9b62-4a2a-8333-7bc83d7a62b4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:59.531115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5b67e7c-9b62-4a2a-8333-7bc83d7a62b4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:59.531890 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5b67e7c-9b62-4a2a-8333-7bc83d7a62b4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:48:59.532332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5b67e7c-9b62-4a2a-8333-7bc83d7a62b4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:48:59.598584 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-16edd28c-544c-453f-813a-3115eb111a6a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:59.609590 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-16edd28c-544c-453f-813a-3115eb111a6a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1263 microversion: 2.1 time: 0.139669 Jul 25 08:48:59.610438 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 189/415] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:59 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1263 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:48:59.719350 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e5b67e7c-9b62-4a2a-8333-7bc83d7a62b4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:48:59.728429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e5b67e7c-9b62-4a2a-8333-7bc83d7a62b4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1317 microversion: 2.1 time: 0.214556 Jul 25 08:48:59.729302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 227/416] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:48:59 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:00.430789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9a887d43-dbda-44cc-b22b-f229c33f3dcd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:00.431956 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9a887d43-dbda-44cc-b22b-f229c33f3dcd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:00.439267 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a887d43-dbda-44cc-b22b-f229c33f3dcd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:00.439729 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a887d43-dbda-44cc-b22b-f229c33f3dcd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:00.440508 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a887d43-dbda-44cc-b22b-f229c33f3dcd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:00.441000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9a887d43-dbda-44cc-b22b-f229c33f3dcd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:00.503063 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9a887d43-dbda-44cc-b22b-f229c33f3dcd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:00.511649 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9a887d43-dbda-44cc-b22b-f229c33f3dcd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1298 microversion: 2.1 time: 0.084672 Jul 25 08:49:00.512877 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 190/417] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:00 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:00.635013 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c30db974-5d7d-4ee6-9eb8-3cdcd75500f6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:00.635602 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c30db974-5d7d-4ee6-9eb8-3cdcd75500f6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:00.642418 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c30db974-5d7d-4ee6-9eb8-3cdcd75500f6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:00.642867 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c30db974-5d7d-4ee6-9eb8-3cdcd75500f6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:00.643622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c30db974-5d7d-4ee6-9eb8-3cdcd75500f6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:00.644051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c30db974-5d7d-4ee6-9eb8-3cdcd75500f6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:00.704622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c30db974-5d7d-4ee6-9eb8-3cdcd75500f6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:00.712053 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c30db974-5d7d-4ee6-9eb8-3cdcd75500f6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1311 microversion: 2.1 time: 0.081157 Jul 25 08:49:00.712637 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 228/418] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:00 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1311 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:00.751436 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1f62a9b0-1e77-4b2e-81a2-557476190642 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:00.752046 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1f62a9b0-1e77-4b2e-81a2-557476190642 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:00.758314 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1f62a9b0-1e77-4b2e-81a2-557476190642 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:00.758773 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1f62a9b0-1e77-4b2e-81a2-557476190642 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:00.759509 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1f62a9b0-1e77-4b2e-81a2-557476190642 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:00.759936 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1f62a9b0-1e77-4b2e-81a2-557476190642 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:00.894624 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1f62a9b0-1e77-4b2e-81a2-557476190642 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:00.902305 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1f62a9b0-1e77-4b2e-81a2-557476190642 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1505 microversion: 2.1 time: 0.154651 Jul 25 08:49:00.902900 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 191/419] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:00 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:01.533305 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-629c60b1-fea9-4513-b089-b25375a553f3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:01.534048 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-629c60b1-fea9-4513-b089-b25375a553f3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:01.540272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-629c60b1-fea9-4513-b089-b25375a553f3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:01.540759 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-629c60b1-fea9-4513-b089-b25375a553f3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:01.541530 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-629c60b1-fea9-4513-b089-b25375a553f3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:01.541964 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-629c60b1-fea9-4513-b089-b25375a553f3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:01.608227 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-629c60b1-fea9-4513-b089-b25375a553f3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:01.610653 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:01.617127 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-629c60b1-fea9-4513-b089-b25375a553f3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1298 microversion: 2.1 time: 0.087687 Jul 25 08:49:01.617705 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 229/420] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:01 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:01.739034 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a40e33ce-66c0-448f-a848-3ea361d17ba0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:01.740676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a40e33ce-66c0-448f-a848-3ea361d17ba0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:01.748044 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a40e33ce-66c0-448f-a848-3ea361d17ba0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:01.748715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a40e33ce-66c0-448f-a848-3ea361d17ba0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:01.749662 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a40e33ce-66c0-448f-a848-3ea361d17ba0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:01.750260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a40e33ce-66c0-448f-a848-3ea361d17ba0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:01.820881 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a40e33ce-66c0-448f-a848-3ea361d17ba0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:01.834450 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a40e33ce-66c0-448f-a848-3ea361d17ba0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1311 microversion: 2.1 time: 0.104862 Jul 25 08:49:01.837161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 192/421] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:01 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:02.637564 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e7727726-97a0-462c-a9d7-42d41260bf60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:02.638172 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e7727726-97a0-462c-a9d7-42d41260bf60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:02.644338 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e7727726-97a0-462c-a9d7-42d41260bf60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:02.645272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e7727726-97a0-462c-a9d7-42d41260bf60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:02.646044 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e7727726-97a0-462c-a9d7-42d41260bf60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:02.646474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e7727726-97a0-462c-a9d7-42d41260bf60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:02.726575 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e7727726-97a0-462c-a9d7-42d41260bf60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:02.736554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e7727726-97a0-462c-a9d7-42d41260bf60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1304 microversion: 2.1 time: 0.102733 Jul 25 08:49:02.737539 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 230/422] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:02 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:02.860123 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b8f7fd3f-8d3d-46a1-ba9d-6bc925597304 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:02.861083 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b8f7fd3f-8d3d-46a1-ba9d-6bc925597304 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:02.868226 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8f7fd3f-8d3d-46a1-ba9d-6bc925597304 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:02.868768 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8f7fd3f-8d3d-46a1-ba9d-6bc925597304 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:02.870062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8f7fd3f-8d3d-46a1-ba9d-6bc925597304 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:02.870784 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8f7fd3f-8d3d-46a1-ba9d-6bc925597304 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:02.964340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b8f7fd3f-8d3d-46a1-ba9d-6bc925597304 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:02.973204 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b8f7fd3f-8d3d-46a1-ba9d-6bc925597304 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1317 microversion: 2.1 time: 0.119316 Jul 25 08:49:02.974177 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 193/423] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:02 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1317 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:03.765749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4fb7c050-e868-4d6d-9f87-66274d8c70b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:03.766346 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4fb7c050-e868-4d6d-9f87-66274d8c70b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:03.789016 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4fb7c050-e868-4d6d-9f87-66274d8c70b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:03.789532 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4fb7c050-e868-4d6d-9f87-66274d8c70b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:03.790362 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4fb7c050-e868-4d6d-9f87-66274d8c70b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:03.793670 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4fb7c050-e868-4d6d-9f87-66274d8c70b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:03.962000 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4fb7c050-e868-4d6d-9f87-66274d8c70b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:03.969829 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4fb7c050-e868-4d6d-9f87-66274d8c70b8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.211839 Jul 25 08:49:03.970507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 231/424] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:03 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:03.994643 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d1c40b24-d903-4c9c-88da-ec57ffd08cb4 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:03.995260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d1c40b24-d903-4c9c-88da-ec57ffd08cb4 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:04.002179 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1c40b24-d903-4c9c-88da-ec57ffd08cb4 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:04.002625 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1c40b24-d903-4c9c-88da-ec57ffd08cb4 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:04.003382 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1c40b24-d903-4c9c-88da-ec57ffd08cb4 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:04.003815 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1c40b24-d903-4c9c-88da-ec57ffd08cb4 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:04.133062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d1c40b24-d903-4c9c-88da-ec57ffd08cb4 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:04.144111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d1c40b24-d903-4c9c-88da-ec57ffd08cb4 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.153121 Jul 25 08:49:04.144796 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 194/425] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:03 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:04.684611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-e1f15bd7-fe64-4781-8385-0c2aa88c0db4 req-6b1bca9c-1d3c-4d0a-a4ca-ceb84aa0039b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d74c6940-419a-4a70-bc74-9e4536cf9805", "tag": "c243097a-4313-4fd5-ad41-f6f18a03b006"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:49:04.698447 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e1f15bd7-fe64-4781-8385-0c2aa88c0db4 req-6b1bca9c-1d3c-4d0a-a4ca-ceb84aa0039b service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:04.700677 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e1f15bd7-fe64-4781-8385-0c2aa88c0db4 req-6b1bca9c-1d3c-4d0a-a4ca-ceb84aa0039b service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:04.728327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-e1f15bd7-fe64-4781-8385-0c2aa88c0db4 req-6b1bca9c-1d3c-4d0a-a4ca-ceb84aa0039b service nova] Creating event network-changed:c243097a-4313-4fd5-ad41-f6f18a03b006 for instance d74c6940-419a-4a70-bc74-9e4536cf9805 on hv-cinder-85084 Jul 25 08:49:04.746423 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-e1f15bd7-fe64-4781-8385-0c2aa88c0db4 req-6b1bca9c-1d3c-4d0a-a4ca-ceb84aa0039b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065322 Jul 25 08:49:04.749879 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 232/426] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:49:04.960685 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1067107443", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:49:04.991717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-74f5902d-2215-4191-8e37-669e1e70d604 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:04.993455 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-74f5902d-2215-4191-8e37-669e1e70d604 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:05.002734 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-74f5902d-2215-4191-8e37-669e1e70d604 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:05.003476 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-74f5902d-2215-4191-8e37-669e1e70d604 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:05.004536 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-74f5902d-2215-4191-8e37-669e1e70d604 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:05.005080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-74f5902d-2215-4191-8e37-669e1e70d604 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:05.162208 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-74f5902d-2215-4191-8e37-669e1e70d604 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:05.171693 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-74f5902d-2215-4191-8e37-669e1e70d604 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.184240 Jul 25 08:49:05.172390 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 233/427] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:04 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:05.180106 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-12651a3b-3aa1-4fe1-98e2-b59932f6a3f9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:05.181119 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-12651a3b-3aa1-4fe1-98e2-b59932f6a3f9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:05.188364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12651a3b-3aa1-4fe1-98e2-b59932f6a3f9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:05.188932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12651a3b-3aa1-4fe1-98e2-b59932f6a3f9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:05.189794 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12651a3b-3aa1-4fe1-98e2-b59932f6a3f9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:05.190387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12651a3b-3aa1-4fe1-98e2-b59932f6a3f9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:05.327025 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-12651a3b-3aa1-4fe1-98e2-b59932f6a3f9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:05.334511 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-12651a3b-3aa1-4fe1-98e2-b59932f6a3f9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.160926 Jul 25 08:49:05.335078 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 234/428] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:05 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:06.193281 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c074c76b-36d2-489d-95b0-e0a41cc907db tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:06.193950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c074c76b-36d2-489d-95b0-e0a41cc907db tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:06.200376 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c074c76b-36d2-489d-95b0-e0a41cc907db tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:06.200928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c074c76b-36d2-489d-95b0-e0a41cc907db tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:06.201696 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c074c76b-36d2-489d-95b0-e0a41cc907db tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:06.202132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c074c76b-36d2-489d-95b0-e0a41cc907db tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:06.337080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c074c76b-36d2-489d-95b0-e0a41cc907db tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:06.345353 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c074c76b-36d2-489d-95b0-e0a41cc907db tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.155902 Jul 25 08:49:06.345924 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 235/429] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:06 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:06.354706 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d36db495-3af3-47c0-99a6-a4f66911469f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:06.355412 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d36db495-3af3-47c0-99a6-a4f66911469f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:06.361395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d36db495-3af3-47c0-99a6-a4f66911469f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:06.361849 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d36db495-3af3-47c0-99a6-a4f66911469f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:06.362617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d36db495-3af3-47c0-99a6-a4f66911469f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:06.363055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d36db495-3af3-47c0-99a6-a4f66911469f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:06.495051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d36db495-3af3-47c0-99a6-a4f66911469f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:06.502294 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d36db495-3af3-47c0-99a6-a4f66911469f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.151229 Jul 25 08:49:06.502848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 236/430] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:06 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:07.017584 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-1c1ddd60-24af-4662-a3f7-88a6f9a38df3 req-2dbc311f-4ec2-4dad-8c82-85c627ddfdd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d", "tag": "39973804-976f-4223-a900-f8cbbe4dcd0e"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:49:07.022620 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:07.028478 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1c1ddd60-24af-4662-a3f7-88a6f9a38df3 req-2dbc311f-4ec2-4dad-8c82-85c627ddfdd9 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:07.028944 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1c1ddd60-24af-4662-a3f7-88a6f9a38df3 req-2dbc311f-4ec2-4dad-8c82-85c627ddfdd9 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:07.040495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-1c1ddd60-24af-4662-a3f7-88a6f9a38df3 req-2dbc311f-4ec2-4dad-8c82-85c627ddfdd9 service nova] Creating event network-changed:39973804-976f-4223-a900-f8cbbe4dcd0e for instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d on hv-cinder-85084 Jul 25 08:49:07.046862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-1c1ddd60-24af-4662-a3f7-88a6f9a38df3 req-2dbc311f-4ec2-4dad-8c82-85c627ddfdd9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033102 Jul 25 08:49:07.047817 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 237/431] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:49:07.368394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d8f54a5d-6efe-4371-8dae-9ded752c6927 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:07.369133 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d8f54a5d-6efe-4371-8dae-9ded752c6927 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:07.375303 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8f54a5d-6efe-4371-8dae-9ded752c6927 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:07.375760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8f54a5d-6efe-4371-8dae-9ded752c6927 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:07.376533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8f54a5d-6efe-4371-8dae-9ded752c6927 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:07.377001 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8f54a5d-6efe-4371-8dae-9ded752c6927 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:07.509967 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d8f54a5d-6efe-4371-8dae-9ded752c6927 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:07.519750 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d8f54a5d-6efe-4371-8dae-9ded752c6927 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.156957 Jul 25 08:49:07.520321 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 238/432] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:07 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:07.525086 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5c5cfc44-8bae-47ab-bbc1-1a5d59de2dd6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:07.525708 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5c5cfc44-8bae-47ab-bbc1-1a5d59de2dd6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:07.532081 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c5cfc44-8bae-47ab-bbc1-1a5d59de2dd6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:07.532524 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c5cfc44-8bae-47ab-bbc1-1a5d59de2dd6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:07.533309 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c5cfc44-8bae-47ab-bbc1-1a5d59de2dd6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:07.533766 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c5cfc44-8bae-47ab-bbc1-1a5d59de2dd6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:07.673464 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5c5cfc44-8bae-47ab-bbc1-1a5d59de2dd6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:07.680907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5c5cfc44-8bae-47ab-bbc1-1a5d59de2dd6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.159307 Jul 25 08:49:07.681468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 239/433] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:07 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:07.704983 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:08.445392 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=10 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:08.540796 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5306d80c-ce6c-4ee5-b38b-6a411d52683d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:08.541402 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5306d80c-ce6c-4ee5-b38b-6a411d52683d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:08.543840 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:08.544495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=10 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:08.550740 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5306d80c-ce6c-4ee5-b38b-6a411d52683d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:08.551186 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5306d80c-ce6c-4ee5-b38b-6a411d52683d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:08.551943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5306d80c-ce6c-4ee5-b38b-6a411d52683d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:08.552381 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5306d80c-ce6c-4ee5-b38b-6a411d52683d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:08.686077 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5306d80c-ce6c-4ee5-b38b-6a411d52683d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:08.693575 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5306d80c-ce6c-4ee5-b38b-6a411d52683d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.156623 Jul 25 08:49:08.694124 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 240/434] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:08 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:08.700871 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8997215f-851a-46ef-9689-abfaa876f480 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:08.701405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8997215f-851a-46ef-9689-abfaa876f480 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:08.707070 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8997215f-851a-46ef-9689-abfaa876f480 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:08.707512 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8997215f-851a-46ef-9689-abfaa876f480 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:08.708259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8997215f-851a-46ef-9689-abfaa876f480 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:08.708715 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8997215f-851a-46ef-9689-abfaa876f480 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:08.843276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8997215f-851a-46ef-9689-abfaa876f480 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:08.850858 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8997215f-851a-46ef-9689-abfaa876f480 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.153401 Jul 25 08:49:08.851487 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 241/435] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:08 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:09.714486 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1c8fb680-b9ff-4d3a-a4db-6134f4d83ecb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:09.715138 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1c8fb680-b9ff-4d3a-a4db-6134f4d83ecb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:09.721872 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c8fb680-b9ff-4d3a-a4db-6134f4d83ecb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:09.722323 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c8fb680-b9ff-4d3a-a4db-6134f4d83ecb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:09.723084 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c8fb680-b9ff-4d3a-a4db-6134f4d83ecb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:09.723519 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c8fb680-b9ff-4d3a-a4db-6134f4d83ecb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:09.854716 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1c8fb680-b9ff-4d3a-a4db-6134f4d83ecb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:09.862218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1c8fb680-b9ff-4d3a-a4db-6134f4d83ecb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.151568 Jul 25 08:49:09.862783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 242/436] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:09 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:09.870865 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f056bbea-cfea-4f84-97fd-5a4241c0ef61 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:09.871553 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f056bbea-cfea-4f84-97fd-5a4241c0ef61 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:09.878113 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f056bbea-cfea-4f84-97fd-5a4241c0ef61 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:09.878576 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f056bbea-cfea-4f84-97fd-5a4241c0ef61 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:09.879335 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f056bbea-cfea-4f84-97fd-5a4241c0ef61 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:09.879776 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f056bbea-cfea-4f84-97fd-5a4241c0ef61 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:10.021119 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f056bbea-cfea-4f84-97fd-5a4241c0ef61 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:10.028671 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f056bbea-cfea-4f84-97fd-5a4241c0ef61 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.161475 Jul 25 08:49:10.029236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 243/437] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:09 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:10.883918 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b5251b2f-83d2-4a0b-ad97-5a3671c38226 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:10.884858 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b5251b2f-83d2-4a0b-ad97-5a3671c38226 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:10.893304 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5251b2f-83d2-4a0b-ad97-5a3671c38226 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:10.893304 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5251b2f-83d2-4a0b-ad97-5a3671c38226 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:10.893304 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5251b2f-83d2-4a0b-ad97-5a3671c38226 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:10.893304 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5251b2f-83d2-4a0b-ad97-5a3671c38226 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:11.031219 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b5251b2f-83d2-4a0b-ad97-5a3671c38226 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:11.038618 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b5251b2f-83d2-4a0b-ad97-5a3671c38226 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.158773 Jul 25 08:49:11.039185 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 244/438] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:10 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:11.056228 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a8337540-ec56-4d0d-b259-d8c20df696d9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:11.056872 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a8337540-ec56-4d0d-b259-d8c20df696d9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:11.063649 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8337540-ec56-4d0d-b259-d8c20df696d9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:11.064090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8337540-ec56-4d0d-b259-d8c20df696d9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:11.064874 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8337540-ec56-4d0d-b259-d8c20df696d9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:11.065304 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8337540-ec56-4d0d-b259-d8c20df696d9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:11.197167 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a8337540-ec56-4d0d-b259-d8c20df696d9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:11.205105 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a8337540-ec56-4d0d-b259-d8c20df696d9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.155435 Jul 25 08:49:11.205670 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 245/439] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:11 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:12.061882 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-644b2fdd-b15b-4f8b-8480-d116e6b26c60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:12.062544 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-644b2fdd-b15b-4f8b-8480-d116e6b26c60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:12.068981 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-644b2fdd-b15b-4f8b-8480-d116e6b26c60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:12.069222 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-644b2fdd-b15b-4f8b-8480-d116e6b26c60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:12.070002 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-644b2fdd-b15b-4f8b-8480-d116e6b26c60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:12.070556 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-644b2fdd-b15b-4f8b-8480-d116e6b26c60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:12.210411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-644b2fdd-b15b-4f8b-8480-d116e6b26c60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:12.218080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-644b2fdd-b15b-4f8b-8480-d116e6b26c60 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.160823 Jul 25 08:49:12.218646 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 246/440] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:12 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:12.226629 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-83b7786d-1c33-479d-8103-c3800d126417 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:12.227228 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-83b7786d-1c33-479d-8103-c3800d126417 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:12.233558 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-83b7786d-1c33-479d-8103-c3800d126417 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:12.234014 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-83b7786d-1c33-479d-8103-c3800d126417 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:12.234762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-83b7786d-1c33-479d-8103-c3800d126417 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:12.235195 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-83b7786d-1c33-479d-8103-c3800d126417 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:12.368485 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-83b7786d-1c33-479d-8103-c3800d126417 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:12.370726 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:12.378444 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-83b7786d-1c33-479d-8103-c3800d126417 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.155296 Jul 25 08:49:12.379358 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 247/441] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:12 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:12.394452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.network.neutron [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] validate_networks() for None {{(pid=124234) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:49:12.677792 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Flavor limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:49:12.678296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Image limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:49:12.679093 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Flavor pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:49:12.679322 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Image pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:49:12.679746 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:49:12.694283 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:12.694736 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:12.695539 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:12.695979 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:12.713294 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Getting quotas for project d63f1e7e45df467f816bc14d6f861934. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:49:12.719371 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Getting quotas for user 28a6dd88b54d47bb83bedb2ef86b728b and project d63f1e7e45df467f816bc14d6f861934. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:49:12.730225 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Going to run 1 instances... {{(pid=124234) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:49:12.732887 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124234) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:49:12.778305 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-61c288a2-cc17-4493-9067-8b594046e484 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.822124 Jul 25 08:49:12.779261 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 195/442] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 7824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:49:12.791665 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dc52751b-2836-409d-b17f-369038d7716d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:12.792284 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dc52751b-2836-409d-b17f-369038d7716d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:12.866496 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dc52751b-2836-409d-b17f-369038d7716d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:12.874070 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dc52751b-2836-409d-b17f-369038d7716d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1215 microversion: 2.1 time: 0.087747 Jul 25 08:49:12.874649 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 248/443] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:12 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:13.242339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dc7987c2-25ae-4405-9114-bb740e8b064d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:13.242914 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dc7987c2-25ae-4405-9114-bb740e8b064d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:13.250380 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc7987c2-25ae-4405-9114-bb740e8b064d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:13.250829 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc7987c2-25ae-4405-9114-bb740e8b064d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:13.251588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc7987c2-25ae-4405-9114-bb740e8b064d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:13.252046 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc7987c2-25ae-4405-9114-bb740e8b064d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:13.399498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f95d7fb9-27f9-40d5-8d2f-3a5af8cd173c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:13.400124 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f95d7fb9-27f9-40d5-8d2f-3a5af8cd173c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:13.406765 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f95d7fb9-27f9-40d5-8d2f-3a5af8cd173c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:13.407447 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f95d7fb9-27f9-40d5-8d2f-3a5af8cd173c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:13.408393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f95d7fb9-27f9-40d5-8d2f-3a5af8cd173c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:13.409024 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f95d7fb9-27f9-40d5-8d2f-3a5af8cd173c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:13.426651 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dc7987c2-25ae-4405-9114-bb740e8b064d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:13.434333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dc7987c2-25ae-4405-9114-bb740e8b064d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.196391 Jul 25 08:49:13.435118 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 196/444] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:13 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:13.543251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f95d7fb9-27f9-40d5-8d2f-3a5af8cd173c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:13.551714 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f95d7fb9-27f9-40d5-8d2f-3a5af8cd173c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.155897 Jul 25 08:49:13.557457 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 249/445] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:13 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:13.895082 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b8287fc6-a940-4b43-a40d-c3cdf761d546 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:13.895697 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b8287fc6-a940-4b43-a40d-c3cdf761d546 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:13.901704 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8287fc6-a940-4b43-a40d-c3cdf761d546 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:13.902154 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8287fc6-a940-4b43-a40d-c3cdf761d546 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:13.902914 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8287fc6-a940-4b43-a40d-c3cdf761d546 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:13.903346 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8287fc6-a940-4b43-a40d-c3cdf761d546 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:13.970997 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b8287fc6-a940-4b43-a40d-c3cdf761d546 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:13.978538 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b8287fc6-a940-4b43-a40d-c3cdf761d546 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.087375 Jul 25 08:49:13.979108 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 197/446] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:13 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:14.458327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3919e3c6-f3ee-4c23-a62c-794ef912261a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:14.458952 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3919e3c6-f3ee-4c23-a62c-794ef912261a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:14.466264 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3919e3c6-f3ee-4c23-a62c-794ef912261a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:14.466749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3919e3c6-f3ee-4c23-a62c-794ef912261a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:14.467551 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3919e3c6-f3ee-4c23-a62c-794ef912261a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:14.467981 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3919e3c6-f3ee-4c23-a62c-794ef912261a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:14.574961 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6e1d3649-f601-476e-bc65-65f1cc192215 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:14.583696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6e1d3649-f601-476e-bc65-65f1cc192215 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:14.598762 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e1d3649-f601-476e-bc65-65f1cc192215 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:14.599313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e1d3649-f601-476e-bc65-65f1cc192215 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:14.600194 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e1d3649-f601-476e-bc65-65f1cc192215 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:14.600749 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6e1d3649-f601-476e-bc65-65f1cc192215 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:14.609884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3919e3c6-f3ee-4c23-a62c-794ef912261a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:14.617722 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3919e3c6-f3ee-4c23-a62c-794ef912261a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.164518 Jul 25 08:49:14.618278 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 250/447] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:14 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:14.736199 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-6e1d3649-f601-476e-bc65-65f1cc192215 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:14.743522 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6e1d3649-f601-476e-bc65-65f1cc192215 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.172749 Jul 25 08:49:14.744077 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 198/448] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:14 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:14.999253 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-86cccd88-862a-4e5c-9a27-222ddf601f28 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:14.999855 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-86cccd88-862a-4e5c-9a27-222ddf601f28 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:15.005868 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86cccd88-862a-4e5c-9a27-222ddf601f28 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:15.006567 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86cccd88-862a-4e5c-9a27-222ddf601f28 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:15.007314 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86cccd88-862a-4e5c-9a27-222ddf601f28 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:15.007743 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86cccd88-862a-4e5c-9a27-222ddf601f28 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:15.069278 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-86cccd88-862a-4e5c-9a27-222ddf601f28 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:15.078888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-86cccd88-862a-4e5c-9a27-222ddf601f28 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.083326 Jul 25 08:49:15.084610 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 251/449] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:14 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:15.638464 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d8d61714-b5ca-4e10-98c7-c4d98e437296 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:15.639078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d8d61714-b5ca-4e10-98c7-c4d98e437296 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:15.646224 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d8d61714-b5ca-4e10-98c7-c4d98e437296 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:15.646676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d8d61714-b5ca-4e10-98c7-c4d98e437296 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:15.647430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d8d61714-b5ca-4e10-98c7-c4d98e437296 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:15.647864 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d8d61714-b5ca-4e10-98c7-c4d98e437296 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:15.765906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2e6f9ce9-d9cf-47cb-936b-8e36a84fc0b9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:15.766504 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2e6f9ce9-d9cf-47cb-936b-8e36a84fc0b9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:15.774082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e6f9ce9-d9cf-47cb-936b-8e36a84fc0b9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:15.774944 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e6f9ce9-d9cf-47cb-936b-8e36a84fc0b9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:15.776180 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e6f9ce9-d9cf-47cb-936b-8e36a84fc0b9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:15.776891 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e6f9ce9-d9cf-47cb-936b-8e36a84fc0b9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:15.788191 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d8d61714-b5ca-4e10-98c7-c4d98e437296 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:15.807068 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d8d61714-b5ca-4e10-98c7-c4d98e437296 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.172278 Jul 25 08:49:15.807668 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 199/450] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:15 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:15.907968 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2e6f9ce9-d9cf-47cb-936b-8e36a84fc0b9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:15.915273 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2e6f9ce9-d9cf-47cb-936b-8e36a84fc0b9 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.153852 Jul 25 08:49:15.915832 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 252/451] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:15 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:16.099315 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f3294888-4050-4d93-b8a3-215c675d15ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:16.099931 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f3294888-4050-4d93-b8a3-215c675d15ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:16.105991 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f3294888-4050-4d93-b8a3-215c675d15ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:16.106446 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f3294888-4050-4d93-b8a3-215c675d15ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:16.107255 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f3294888-4050-4d93-b8a3-215c675d15ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:16.107650 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f3294888-4050-4d93-b8a3-215c675d15ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:16.172809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f3294888-4050-4d93-b8a3-215c675d15ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:16.182253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f3294888-4050-4d93-b8a3-215c675d15ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.086744 Jul 25 08:49:16.183058 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 200/452] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:16 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:16.827881 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e9f4a676-9481-401c-a567-12d071d4c56f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:16.828498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e9f4a676-9481-401c-a567-12d071d4c56f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:16.834631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e9f4a676-9481-401c-a567-12d071d4c56f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:16.835084 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e9f4a676-9481-401c-a567-12d071d4c56f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:16.835848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e9f4a676-9481-401c-a567-12d071d4c56f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:16.836288 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e9f4a676-9481-401c-a567-12d071d4c56f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:16.936212 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-320e7acd-8f88-42b9-bb1e-6cca16f160ae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:16.936840 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-320e7acd-8f88-42b9-bb1e-6cca16f160ae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:16.945306 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-320e7acd-8f88-42b9-bb1e-6cca16f160ae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:16.946305 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-320e7acd-8f88-42b9-bb1e-6cca16f160ae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:16.947271 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-320e7acd-8f88-42b9-bb1e-6cca16f160ae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:16.947877 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-320e7acd-8f88-42b9-bb1e-6cca16f160ae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:16.976760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e9f4a676-9481-401c-a567-12d071d4c56f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:16.987601 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e9f4a676-9481-401c-a567-12d071d4c56f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.161630 Jul 25 08:49:16.991729 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 253/453] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:16 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:17.089915 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-320e7acd-8f88-42b9-bb1e-6cca16f160ae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:17.099937 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-320e7acd-8f88-42b9-bb1e-6cca16f160ae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.167486 Jul 25 08:49:17.100523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 201/454] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:16 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:17.205240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c05bd143-06cc-4410-a389-10facacd39b1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:17.205864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c05bd143-06cc-4410-a389-10facacd39b1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:17.212784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c05bd143-06cc-4410-a389-10facacd39b1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:17.213346 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c05bd143-06cc-4410-a389-10facacd39b1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:17.214156 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c05bd143-06cc-4410-a389-10facacd39b1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:17.214814 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c05bd143-06cc-4410-a389-10facacd39b1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:17.279715 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c05bd143-06cc-4410-a389-10facacd39b1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:17.288845 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c05bd143-06cc-4410-a389-10facacd39b1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.088994 Jul 25 08:49:17.289426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 254/455] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:17 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:18.011156 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4f1b4928-1bef-4af3-a102-c0e3d7a07da3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:18.011828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4f1b4928-1bef-4af3-a102-c0e3d7a07da3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:18.018368 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f1b4928-1bef-4af3-a102-c0e3d7a07da3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:18.018822 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f1b4928-1bef-4af3-a102-c0e3d7a07da3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:18.019584 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f1b4928-1bef-4af3-a102-c0e3d7a07da3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:18.020021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f1b4928-1bef-4af3-a102-c0e3d7a07da3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:18.120904 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-235e2cf5-6265-4526-9986-29477ba1f10a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:18.121540 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-235e2cf5-6265-4526-9986-29477ba1f10a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:18.127621 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-235e2cf5-6265-4526-9986-29477ba1f10a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:18.128074 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-235e2cf5-6265-4526-9986-29477ba1f10a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:18.128874 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-235e2cf5-6265-4526-9986-29477ba1f10a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:18.129314 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-235e2cf5-6265-4526-9986-29477ba1f10a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:18.156419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4f1b4928-1bef-4af3-a102-c0e3d7a07da3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:18.163852 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4f1b4928-1bef-4af3-a102-c0e3d7a07da3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.156597 Jul 25 08:49:18.164420 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 202/456] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:18 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:18.262566 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-235e2cf5-6265-4526-9986-29477ba1f10a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:18.270733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-235e2cf5-6265-4526-9986-29477ba1f10a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.153632 Jul 25 08:49:18.271303 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 255/457] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:18 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:18.309381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5b5a0270-f797-4cdc-bb02-f4d6c30cae97 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:18.309998 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5b5a0270-f797-4cdc-bb02-f4d6c30cae97 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:18.316692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5b5a0270-f797-4cdc-bb02-f4d6c30cae97 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:18.317139 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5b5a0270-f797-4cdc-bb02-f4d6c30cae97 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:18.317897 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5b5a0270-f797-4cdc-bb02-f4d6c30cae97 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:18.318332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5b5a0270-f797-4cdc-bb02-f4d6c30cae97 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:18.394325 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5b5a0270-f797-4cdc-bb02-f4d6c30cae97 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:18.401650 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5b5a0270-f797-4cdc-bb02-f4d6c30cae97 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.096098 Jul 25 08:49:18.402201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 203/458] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:18 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:19.184610 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-462032ed-20a5-43f3-8b91-5dd0752da560 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:19.185198 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-462032ed-20a5-43f3-8b91-5dd0752da560 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:19.192002 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-462032ed-20a5-43f3-8b91-5dd0752da560 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:19.192461 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-462032ed-20a5-43f3-8b91-5dd0752da560 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:19.193273 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-462032ed-20a5-43f3-8b91-5dd0752da560 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:19.193708 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-462032ed-20a5-43f3-8b91-5dd0752da560 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:19.294188 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-49ee3f07-e3ac-48cf-800d-9002c77b762a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:19.294901 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-49ee3f07-e3ac-48cf-800d-9002c77b762a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:19.303411 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49ee3f07-e3ac-48cf-800d-9002c77b762a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:19.303795 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49ee3f07-e3ac-48cf-800d-9002c77b762a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:19.304566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49ee3f07-e3ac-48cf-800d-9002c77b762a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:19.305017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49ee3f07-e3ac-48cf-800d-9002c77b762a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:19.326219 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-462032ed-20a5-43f3-8b91-5dd0752da560 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:19.334406 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-462032ed-20a5-43f3-8b91-5dd0752da560 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.153650 Jul 25 08:49:19.348617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 256/459] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:19 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:19.424862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aa52cd97-2dc5-4fca-843d-bd6b742e5384 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:19.426208 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-aa52cd97-2dc5-4fca-843d-bd6b742e5384 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:19.434079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa52cd97-2dc5-4fca-843d-bd6b742e5384 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:19.434272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa52cd97-2dc5-4fca-843d-bd6b742e5384 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:19.435201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa52cd97-2dc5-4fca-843d-bd6b742e5384 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:19.435780 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa52cd97-2dc5-4fca-843d-bd6b742e5384 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:19.468965 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-49ee3f07-e3ac-48cf-800d-9002c77b762a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:19.477320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-49ee3f07-e3ac-48cf-800d-9002c77b762a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.188893 Jul 25 08:49:19.477916 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 204/460] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:19 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:19.505954 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-aa52cd97-2dc5-4fca-843d-bd6b742e5384 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:19.514789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-aa52cd97-2dc5-4fca-843d-bd6b742e5384 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.095590 Jul 25 08:49:19.515613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 257/461] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:19 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:20.355578 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2b4e7eeb-8b91-4753-80e7-fc6da7db43b2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:20.357107 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2b4e7eeb-8b91-4753-80e7-fc6da7db43b2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:20.365010 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2b4e7eeb-8b91-4753-80e7-fc6da7db43b2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:20.365848 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2b4e7eeb-8b91-4753-80e7-fc6da7db43b2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:20.366835 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2b4e7eeb-8b91-4753-80e7-fc6da7db43b2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:20.367264 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2b4e7eeb-8b91-4753-80e7-fc6da7db43b2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:20.371579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=100 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:20.498159 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f3a3c4d7-b3ee-4532-9c50-8961560ae70e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:20.498818 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f3a3c4d7-b3ee-4532-9c50-8961560ae70e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:20.506678 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f3a3c4d7-b3ee-4532-9c50-8961560ae70e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:20.507127 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f3a3c4d7-b3ee-4532-9c50-8961560ae70e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:20.507276 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2b4e7eeb-8b91-4753-80e7-fc6da7db43b2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:20.507906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f3a3c4d7-b3ee-4532-9c50-8961560ae70e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:20.508523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f3a3c4d7-b3ee-4532-9c50-8961560ae70e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:20.516617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2b4e7eeb-8b91-4753-80e7-fc6da7db43b2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.164972 Jul 25 08:49:20.517422 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 205/462] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:20 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:20.541672 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ce57e35b-8d94-43c6-9517-c3cca33aa8fc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:20.542289 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ce57e35b-8d94-43c6-9517-c3cca33aa8fc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:20.548361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ce57e35b-8d94-43c6-9517-c3cca33aa8fc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:20.548904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ce57e35b-8d94-43c6-9517-c3cca33aa8fc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:20.549904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ce57e35b-8d94-43c6-9517-c3cca33aa8fc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:20.550333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ce57e35b-8d94-43c6-9517-c3cca33aa8fc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:20.621325 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ce57e35b-8d94-43c6-9517-c3cca33aa8fc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:20.633146 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ce57e35b-8d94-43c6-9517-c3cca33aa8fc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.099915 Jul 25 08:49:20.634469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 206/463] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:20 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:20.683202 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f3a3c4d7-b3ee-4532-9c50-8961560ae70e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:20.691580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f3a3c4d7-b3ee-4532-9c50-8961560ae70e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.197148 Jul 25 08:49:20.692257 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 258/464] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:20 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:21.539336 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-67665015-1bc3-44c1-8055-9143b4b8f2e1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:21.539974 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-67665015-1bc3-44c1-8055-9143b4b8f2e1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:21.547728 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67665015-1bc3-44c1-8055-9143b4b8f2e1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:21.548182 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67665015-1bc3-44c1-8055-9143b4b8f2e1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:21.548992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67665015-1bc3-44c1-8055-9143b4b8f2e1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:21.549424 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67665015-1bc3-44c1-8055-9143b4b8f2e1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:21.652514 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b5860821-ebf5-43b2-8313-b09d9063b641 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:21.653251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b5860821-ebf5-43b2-8313-b09d9063b641 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:21.660387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5860821-ebf5-43b2-8313-b09d9063b641 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:21.660944 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5860821-ebf5-43b2-8313-b09d9063b641 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:21.661804 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5860821-ebf5-43b2-8313-b09d9063b641 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:21.662698 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5860821-ebf5-43b2-8313-b09d9063b641 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:21.697831 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-67665015-1bc3-44c1-8055-9143b4b8f2e1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:21.717620 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-67665015-1bc3-44c1-8055-9143b4b8f2e1 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.181630 Jul 25 08:49:21.718195 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 207/465] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:21 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:21.722574 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3ff1139c-1778-4984-8b55-ae8d5690df13 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:21.723180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3ff1139c-1778-4984-8b55-ae8d5690df13 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:21.726141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b5860821-ebf5-43b2-8313-b09d9063b641 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:21.733964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3ff1139c-1778-4984-8b55-ae8d5690df13 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:21.734418 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3ff1139c-1778-4984-8b55-ae8d5690df13 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:21.735213 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3ff1139c-1778-4984-8b55-ae8d5690df13 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:21.735682 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3ff1139c-1778-4984-8b55-ae8d5690df13 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:21.735959 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b5860821-ebf5-43b2-8313-b09d9063b641 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.086987 Jul 25 08:49:21.749165 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 259/466] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:21 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:21.867008 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3ff1139c-1778-4984-8b55-ae8d5690df13 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:21.874844 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3ff1139c-1778-4984-8b55-ae8d5690df13 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.155722 Jul 25 08:49:21.875410 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 208/467] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:21 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:22.739483 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f36382c2-31c0-42b0-8606-88c1c7862d3f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:22.740101 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f36382c2-31c0-42b0-8606-88c1c7862d3f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:22.746069 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f36382c2-31c0-42b0-8606-88c1c7862d3f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:22.746523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f36382c2-31c0-42b0-8606-88c1c7862d3f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:22.747288 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f36382c2-31c0-42b0-8606-88c1c7862d3f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:22.747726 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f36382c2-31c0-42b0-8606-88c1c7862d3f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:22.757695 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c3a89ecb-7127-42fa-85f2-0a202cdba0ad tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:22.758309 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c3a89ecb-7127-42fa-85f2-0a202cdba0ad tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:22.760658 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:22.761521 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=6 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:22.767098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c3a89ecb-7127-42fa-85f2-0a202cdba0ad tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:22.767576 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c3a89ecb-7127-42fa-85f2-0a202cdba0ad tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:22.768349 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c3a89ecb-7127-42fa-85f2-0a202cdba0ad tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:22.768804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c3a89ecb-7127-42fa-85f2-0a202cdba0ad tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:22.846791 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c3a89ecb-7127-42fa-85f2-0a202cdba0ad tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:22.858700 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c3a89ecb-7127-42fa-85f2-0a202cdba0ad tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.104853 Jul 25 08:49:22.859797 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 209/468] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:22 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:22.872552 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:22.895882 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-36be6115-df8e-4fca-8389-4a3cf22195a1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:22.896707 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-36be6115-df8e-4fca-8389-4a3cf22195a1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:22.902886 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-36be6115-df8e-4fca-8389-4a3cf22195a1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:22.903330 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-36be6115-df8e-4fca-8389-4a3cf22195a1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:22.904088 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-36be6115-df8e-4fca-8389-4a3cf22195a1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:22.904548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-36be6115-df8e-4fca-8389-4a3cf22195a1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:22.922021 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f36382c2-31c0-42b0-8606-88c1c7862d3f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:22.929938 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f36382c2-31c0-42b0-8606-88c1c7862d3f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.194231 Jul 25 08:49:22.930606 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 260/469] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:22 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:23.044368 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-36be6115-df8e-4fca-8389-4a3cf22195a1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:23.051814 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-36be6115-df8e-4fca-8389-4a3cf22195a1 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.159818 Jul 25 08:49:23.052368 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 210/470] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:22 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:23.879266 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6f77fec6-e4b5-42d8-be97-625d7c3282c2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:23.879912 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6f77fec6-e4b5-42d8-be97-625d7c3282c2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:23.886439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6f77fec6-e4b5-42d8-be97-625d7c3282c2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:23.886898 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6f77fec6-e4b5-42d8-be97-625d7c3282c2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:23.887665 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6f77fec6-e4b5-42d8-be97-625d7c3282c2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:23.888102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6f77fec6-e4b5-42d8-be97-625d7c3282c2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:23.946378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6f77fec6-e4b5-42d8-be97-625d7c3282c2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:23.950590 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f0d56049-fe73-4070-a644-f39353d72c55 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:23.951220 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f0d56049-fe73-4070-a644-f39353d72c55 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:23.953898 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6f77fec6-e4b5-42d8-be97-625d7c3282c2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.078493 Jul 25 08:49:23.954464 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 261/471] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:23 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:23.957860 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f0d56049-fe73-4070-a644-f39353d72c55 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:23.958398 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f0d56049-fe73-4070-a644-f39353d72c55 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:23.959234 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f0d56049-fe73-4070-a644-f39353d72c55 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:23.959744 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f0d56049-fe73-4070-a644-f39353d72c55 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:24.073038 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-46e5d6c4-e799-4d74-bbe3-17a366a67786 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:24.073653 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-46e5d6c4-e799-4d74-bbe3-17a366a67786 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:24.080145 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46e5d6c4-e799-4d74-bbe3-17a366a67786 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:24.080682 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46e5d6c4-e799-4d74-bbe3-17a366a67786 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:24.081479 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46e5d6c4-e799-4d74-bbe3-17a366a67786 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:24.081962 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46e5d6c4-e799-4d74-bbe3-17a366a67786 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:24.116441 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f0d56049-fe73-4070-a644-f39353d72c55 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:24.127956 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f0d56049-fe73-4070-a644-f39353d72c55 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.181148 Jul 25 08:49:24.129950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 211/472] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:23 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:24.224411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-46e5d6c4-e799-4d74-bbe3-17a366a67786 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:24.231918 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-46e5d6c4-e799-4d74-bbe3-17a366a67786 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.162647 Jul 25 08:49:24.232484 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 262/473] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:24 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:24.974419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d018e06b-0eaa-4829-919d-a67aa87df017 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:24.975007 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d018e06b-0eaa-4829-919d-a67aa87df017 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:24.977339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:24.982606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d018e06b-0eaa-4829-919d-a67aa87df017 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:24.983054 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d018e06b-0eaa-4829-919d-a67aa87df017 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:24.983817 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d018e06b-0eaa-4829-919d-a67aa87df017 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:24.984243 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d018e06b-0eaa-4829-919d-a67aa87df017 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:25.044124 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d018e06b-0eaa-4829-919d-a67aa87df017 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:25.051668 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d018e06b-0eaa-4829-919d-a67aa87df017 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.081225 Jul 25 08:49:25.052238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 212/474] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:24 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:25.150925 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-36a98429-5eb5-4aac-86be-8b8c28f3db3c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:25.151506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-36a98429-5eb5-4aac-86be-8b8c28f3db3c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:25.158498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-36a98429-5eb5-4aac-86be-8b8c28f3db3c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:25.158943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-36a98429-5eb5-4aac-86be-8b8c28f3db3c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:25.159782 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-36a98429-5eb5-4aac-86be-8b8c28f3db3c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:25.160309 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-36a98429-5eb5-4aac-86be-8b8c28f3db3c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:25.253617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ca05ae66-4b0e-4591-b64b-e3814ba45701 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:25.254265 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ca05ae66-4b0e-4591-b64b-e3814ba45701 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:25.260447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca05ae66-4b0e-4591-b64b-e3814ba45701 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:25.260931 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca05ae66-4b0e-4591-b64b-e3814ba45701 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:25.261696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca05ae66-4b0e-4591-b64b-e3814ba45701 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:25.262129 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca05ae66-4b0e-4591-b64b-e3814ba45701 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:25.291740 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-36a98429-5eb5-4aac-86be-8b8c28f3db3c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:25.302337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-36a98429-5eb5-4aac-86be-8b8c28f3db3c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.155039 Jul 25 08:49:25.303230 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 263/475] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:25 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:25.402020 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ca05ae66-4b0e-4591-b64b-e3814ba45701 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:25.410983 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ca05ae66-4b0e-4591-b64b-e3814ba45701 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.161047 Jul 25 08:49:25.412047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 213/476] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:25 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:26.058651 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e86b567b-7619-49b4-9244-e880b9c423cb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:26.059144 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e86b567b-7619-49b4-9244-e880b9c423cb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:26.065997 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e86b567b-7619-49b4-9244-e880b9c423cb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:26.066640 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e86b567b-7619-49b4-9244-e880b9c423cb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:26.067535 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e86b567b-7619-49b4-9244-e880b9c423cb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:26.067970 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e86b567b-7619-49b4-9244-e880b9c423cb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:26.072169 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-30cb0f75-67c5-40ae-b840-a9dfb73303f1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:26.072808 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-30cb0f75-67c5-40ae-b840-a9dfb73303f1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:26.080261 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30cb0f75-67c5-40ae-b840-a9dfb73303f1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:26.080749 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30cb0f75-67c5-40ae-b840-a9dfb73303f1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:26.081529 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30cb0f75-67c5-40ae-b840-a9dfb73303f1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:26.081968 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30cb0f75-67c5-40ae-b840-a9dfb73303f1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:26.096919 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e86b567b-7619-49b4-9244-e880b9c423cb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/ips" status: 200 len: 149 microversion: 2.1 time: 0.042102 Jul 25 08:49:26.097824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 264/477] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Jul 25 08:49:26 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:49:26.156145 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-30cb0f75-67c5-40ae-b840-a9dfb73303f1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:26.163498 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-30cb0f75-67c5-40ae-b840-a9dfb73303f1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.095399 Jul 25 08:49:26.164195 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 214/478] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:26 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:26.327330 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ed83cca4-d0bd-4637-8e74-e3ae2e64f667 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:26.327953 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ed83cca4-d0bd-4637-8e74-e3ae2e64f667 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:26.342577 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed83cca4-d0bd-4637-8e74-e3ae2e64f667 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:26.343348 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed83cca4-d0bd-4637-8e74-e3ae2e64f667 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:26.344299 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed83cca4-d0bd-4637-8e74-e3ae2e64f667 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:26.344917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed83cca4-d0bd-4637-8e74-e3ae2e64f667 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:26.432947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e1dd7f2e-a260-4b12-91c2-05f7d2f31433 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:26.433581 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e1dd7f2e-a260-4b12-91c2-05f7d2f31433 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:26.442188 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e1dd7f2e-a260-4b12-91c2-05f7d2f31433 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:26.446648 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e1dd7f2e-a260-4b12-91c2-05f7d2f31433 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:26.447530 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e1dd7f2e-a260-4b12-91c2-05f7d2f31433 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:26.447977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e1dd7f2e-a260-4b12-91c2-05f7d2f31433 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:26.536558 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ed83cca4-d0bd-4637-8e74-e3ae2e64f667 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:26.538779 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:26.544776 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ed83cca4-d0bd-4637-8e74-e3ae2e64f667 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.225133 Jul 25 08:49:26.545379 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 265/479] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:26 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:26.599764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e1dd7f2e-a260-4b12-91c2-05f7d2f31433 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:26.607502 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e1dd7f2e-a260-4b12-91c2-05f7d2f31433 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.178334 Jul 25 08:49:26.608062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 215/480] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:26 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:27.186424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cfc40dee-f9a1-4340-93bf-2f5c7b5bc325 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:27.187148 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cfc40dee-f9a1-4340-93bf-2f5c7b5bc325 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:27.193943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cfc40dee-f9a1-4340-93bf-2f5c7b5bc325 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:27.194484 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cfc40dee-f9a1-4340-93bf-2f5c7b5bc325 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:27.195351 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cfc40dee-f9a1-4340-93bf-2f5c7b5bc325 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:27.195862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cfc40dee-f9a1-4340-93bf-2f5c7b5bc325 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:27.254587 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cfc40dee-f9a1-4340-93bf-2f5c7b5bc325 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:27.261986 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cfc40dee-f9a1-4340-93bf-2f5c7b5bc325 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.080885 Jul 25 08:49:27.262550 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 266/481] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:27 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:27.565158 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dc857317-8584-41aa-87d8-738b98d57118 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:27.565796 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dc857317-8584-41aa-87d8-738b98d57118 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:27.572426 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc857317-8584-41aa-87d8-738b98d57118 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:27.572914 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc857317-8584-41aa-87d8-738b98d57118 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:27.573685 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc857317-8584-41aa-87d8-738b98d57118 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:27.574127 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dc857317-8584-41aa-87d8-738b98d57118 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:27.628245 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-73a62f09-c90e-452c-bd75-74707af7bb8a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:27.628898 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-73a62f09-c90e-452c-bd75-74707af7bb8a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:27.635211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-73a62f09-c90e-452c-bd75-74707af7bb8a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:27.635668 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-73a62f09-c90e-452c-bd75-74707af7bb8a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:27.636488 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-73a62f09-c90e-452c-bd75-74707af7bb8a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:27.636948 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-73a62f09-c90e-452c-bd75-74707af7bb8a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:27.983747 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dc857317-8584-41aa-87d8-738b98d57118 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:27.988758 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-73a62f09-c90e-452c-bd75-74707af7bb8a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:27.991675 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dc857317-8584-41aa-87d8-738b98d57118 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.430315 Jul 25 08:49:27.992885 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 216/482] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:27 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:27.996746 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-73a62f09-c90e-452c-bd75-74707af7bb8a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.372201 Jul 25 08:49:27.997575 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 267/483] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:27 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:28.282515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-787b73ed-a17d-4830-a720-aec924604763 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:28.283056 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-787b73ed-a17d-4830-a720-aec924604763 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:28.289082 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-787b73ed-a17d-4830-a720-aec924604763 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:28.289538 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-787b73ed-a17d-4830-a720-aec924604763 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:28.290302 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-787b73ed-a17d-4830-a720-aec924604763 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:28.290737 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-787b73ed-a17d-4830-a720-aec924604763 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:28.354936 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-787b73ed-a17d-4830-a720-aec924604763 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:28.363054 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-787b73ed-a17d-4830-a720-aec924604763 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.085001 Jul 25 08:49:28.363624 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 217/484] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:28 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:28.590275 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-363cfc58-f474-4963-ab41-ebe21763e01e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0033be9d-b38a-46f7-bbab-f061afb7b267"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:49:28.592819 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-363cfc58-f474-4963-ab41-ebe21763e01e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:28.599224 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-363cfc58-f474-4963-ab41-ebe21763e01e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:28.599676 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-363cfc58-f474-4963-ab41-ebe21763e01e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:28.600440 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-363cfc58-f474-4963-ab41-ebe21763e01e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:28.600918 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-363cfc58-f474-4963-ab41-ebe21763e01e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:29.012780 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-55bacc2e-8e87-4dd0-9f67-51d14cb168eb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:29.013422 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-55bacc2e-8e87-4dd0-9f67-51d14cb168eb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:29.019848 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-55bacc2e-8e87-4dd0-9f67-51d14cb168eb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:29.020325 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-55bacc2e-8e87-4dd0-9f67-51d14cb168eb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:29.021105 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-55bacc2e-8e87-4dd0-9f67-51d14cb168eb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:29.021532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-55bacc2e-8e87-4dd0-9f67-51d14cb168eb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:29.149873 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-55bacc2e-8e87-4dd0-9f67-51d14cb168eb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:29.158110 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-55bacc2e-8e87-4dd0-9f67-51d14cb168eb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.148845 Jul 25 08:49:29.158681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 218/485] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:29 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:29.162961 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e86c96e5-8d9d-4390-9f12-05e6133ade0d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:29.163573 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e86c96e5-8d9d-4390-9f12-05e6133ade0d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:29.169111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e86c96e5-8d9d-4390-9f12-05e6133ade0d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:29.169563 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e86c96e5-8d9d-4390-9f12-05e6133ade0d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:29.171019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e86c96e5-8d9d-4390-9f12-05e6133ade0d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:29.171399 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e86c96e5-8d9d-4390-9f12-05e6133ade0d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:29.294031 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e86c96e5-8d9d-4390-9f12-05e6133ade0d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:29.302051 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e86c96e5-8d9d-4390-9f12-05e6133ade0d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.142422 Jul 25 08:49:29.302618 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 219/486] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:29 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:29.307120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4fd4731a-e7e1-4a98-aa2c-dbd90f3bb18b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:29.307611 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4fd4731a-e7e1-4a98-aa2c-dbd90f3bb18b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:29.313843 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4fd4731a-e7e1-4a98-aa2c-dbd90f3bb18b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:29.314296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4fd4731a-e7e1-4a98-aa2c-dbd90f3bb18b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:29.315055 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4fd4731a-e7e1-4a98-aa2c-dbd90f3bb18b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:29.315491 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4fd4731a-e7e1-4a98-aa2c-dbd90f3bb18b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:29.337937 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4fd4731a-e7e1-4a98-aa2c-dbd90f3bb18b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/ips" status: 200 len: 147 microversion: 2.1 time: 0.034359 Jul 25 08:49:29.338496 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 220/487] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Jul 25 08:49:29 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/ips => generated 147 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:49:29.383878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bbf4a7f7-0722-46e3-8327-5a4ff2fb1a03 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:29.384484 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bbf4a7f7-0722-46e3-8327-5a4ff2fb1a03 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:29.391046 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bbf4a7f7-0722-46e3-8327-5a4ff2fb1a03 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:29.391529 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bbf4a7f7-0722-46e3-8327-5a4ff2fb1a03 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:29.392278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bbf4a7f7-0722-46e3-8327-5a4ff2fb1a03 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:29.392734 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bbf4a7f7-0722-46e3-8327-5a4ff2fb1a03 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:29.454377 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bbf4a7f7-0722-46e3-8327-5a4ff2fb1a03 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:29.461649 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bbf4a7f7-0722-46e3-8327-5a4ff2fb1a03 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.081727 Jul 25 08:49:29.462209 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 221/488] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:29 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:30.178861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d36e6058-de39-4f24-a24d-c9b4e26e31ec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:30.179483 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d36e6058-de39-4f24-a24d-c9b4e26e31ec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:30.191353 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d36e6058-de39-4f24-a24d-c9b4e26e31ec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:30.191353 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d36e6058-de39-4f24-a24d-c9b4e26e31ec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:30.191353 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d36e6058-de39-4f24-a24d-c9b4e26e31ec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:30.191353 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d36e6058-de39-4f24-a24d-c9b4e26e31ec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:30.194012 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=100 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:30.324865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d36e6058-de39-4f24-a24d-c9b4e26e31ec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:30.332331 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d36e6058-de39-4f24-a24d-c9b4e26e31ec tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.157726 Jul 25 08:49:30.332914 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 222/489] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:30 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:30.337195 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dbe16ebc-514d-4973-b586-da7bc272f123 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:30.337803 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dbe16ebc-514d-4973-b586-da7bc272f123 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:30.343322 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dbe16ebc-514d-4973-b586-da7bc272f123 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:30.343796 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dbe16ebc-514d-4973-b586-da7bc272f123 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:30.344713 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dbe16ebc-514d-4973-b586-da7bc272f123 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:30.345107 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dbe16ebc-514d-4973-b586-da7bc272f123 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:30.467189 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dbe16ebc-514d-4973-b586-da7bc272f123 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:30.474490 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dbe16ebc-514d-4973-b586-da7bc272f123 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.140649 Jul 25 08:49:30.475049 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 223/490] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:30 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:30.482100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-421796e6-d173-47bb-a371-835491e29ee1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:30.483213 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-421796e6-d173-47bb-a371-835491e29ee1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:30.488922 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-421796e6-d173-47bb-a371-835491e29ee1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:30.489369 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-421796e6-d173-47bb-a371-835491e29ee1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:30.490123 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-421796e6-d173-47bb-a371-835491e29ee1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:30.490556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-421796e6-d173-47bb-a371-835491e29ee1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:30.552849 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-421796e6-d173-47bb-a371-835491e29ee1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:30.560044 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-421796e6-d173-47bb-a371-835491e29ee1 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.081475 Jul 25 08:49:30.560617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 224/491] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:30 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:31.352521 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-366afb3f-2315-406e-b9a7-cd417ba976e8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:31.353223 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-366afb3f-2315-406e-b9a7-cd417ba976e8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:31.360040 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-366afb3f-2315-406e-b9a7-cd417ba976e8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:31.360481 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-366afb3f-2315-406e-b9a7-cd417ba976e8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:31.361262 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-366afb3f-2315-406e-b9a7-cd417ba976e8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:31.361692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-366afb3f-2315-406e-b9a7-cd417ba976e8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:31.484764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-366afb3f-2315-406e-b9a7-cd417ba976e8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:31.492068 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-366afb3f-2315-406e-b9a7-cd417ba976e8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.143328 Jul 25 08:49:31.492647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 225/492] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:31 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:31.496933 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-20c41dfe-d4a7-4df0-8469-afa17d4f1244 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:31.497532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-20c41dfe-d4a7-4df0-8469-afa17d4f1244 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:31.503571 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20c41dfe-d4a7-4df0-8469-afa17d4f1244 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:31.504021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20c41dfe-d4a7-4df0-8469-afa17d4f1244 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:31.504811 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20c41dfe-d4a7-4df0-8469-afa17d4f1244 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:31.505248 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20c41dfe-d4a7-4df0-8469-afa17d4f1244 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:31.629882 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-20c41dfe-d4a7-4df0-8469-afa17d4f1244 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:31.637429 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-20c41dfe-d4a7-4df0-8469-afa17d4f1244 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.143852 Jul 25 08:49:31.637986 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 226/493] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:31 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:31.642857 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5754d38c-6729-4895-84d7-936dc00519ea tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:31.643456 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5754d38c-6729-4895-84d7-936dc00519ea tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:31.649049 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5754d38c-6729-4895-84d7-936dc00519ea tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:31.649496 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5754d38c-6729-4895-84d7-936dc00519ea tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:31.650249 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5754d38c-6729-4895-84d7-936dc00519ea tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:31.650690 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5754d38c-6729-4895-84d7-936dc00519ea tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:31.711445 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5754d38c-6729-4895-84d7-936dc00519ea tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:31.718726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5754d38c-6729-4895-84d7-936dc00519ea tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1219 microversion: 2.1 time: 0.079762 Jul 25 08:49:31.719287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 227/494] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:31 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:32.364112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bd15db6c-8950-4850-ac9a-a5f3b8a006f4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ace2a96f-3a2d-4c5c-b7d2-0813f8368009"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:49:32.366562 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bd15db6c-8950-4850-ac9a-a5f3b8a006f4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:32.373044 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd15db6c-8950-4850-ac9a-a5f3b8a006f4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:32.373496 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd15db6c-8950-4850-ac9a-a5f3b8a006f4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:32.374278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd15db6c-8950-4850-ac9a-a5f3b8a006f4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:32.374713 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd15db6c-8950-4850-ac9a-a5f3b8a006f4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:38.596793 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=65 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:38.674319 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=19 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:42.370851 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=33 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:42.444077 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=40 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:46.887453 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bd15db6c-8950-4850-ac9a-a5f3b8a006f4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.526998 Jul 25 08:49:46.889440 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 228/495] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:49:32 2022] POST /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/os-volume_attachments => generated 194 bytes in 14530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:49:46.912975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-60e9a3a8-5680-40b0-87d9-4f45b972d6cb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:46.912975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-60e9a3a8-5680-40b0-87d9-4f45b972d6cb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:46.917013 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60e9a3a8-5680-40b0-87d9-4f45b972d6cb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:46.918130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60e9a3a8-5680-40b0-87d9-4f45b972d6cb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:46.919038 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60e9a3a8-5680-40b0-87d9-4f45b972d6cb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:46.919555 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60e9a3a8-5680-40b0-87d9-4f45b972d6cb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:46.933749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-363cfc58-f474-4963-ab41-ebe21763e01e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 18.346026 Jul 25 08:49:46.934790 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 268/496] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:49:28 2022] POST /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments => generated 194 bytes in 18349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:49:46.943041 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7e69ef57-6698-401f-9875-3222560f0a62 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:46.943927 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7e69ef57-6698-401f-9875-3222560f0a62 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:46.951082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7e69ef57-6698-401f-9875-3222560f0a62 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:46.951534 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7e69ef57-6698-401f-9875-3222560f0a62 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:46.952310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7e69ef57-6698-401f-9875-3222560f0a62 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:46.952891 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7e69ef57-6698-401f-9875-3222560f0a62 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:47.166149 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-60e9a3a8-5680-40b0-87d9-4f45b972d6cb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:47.169969 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7e69ef57-6698-401f-9875-3222560f0a62 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:47.174542 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-60e9a3a8-5680-40b0-87d9-4f45b972d6cb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.283356 Jul 25 08:49:47.175115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 229/497] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:46 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:47.180195 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7e80f398-3cda-4742-9b32-570addb0ea77 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:47.180481 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7e69ef57-6698-401f-9875-3222560f0a62 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.244435 Jul 25 08:49:47.180838 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7e80f398-3cda-4742-9b32-570addb0ea77 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:47.188625 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 269/498] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:46 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:47.188782 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7e80f398-3cda-4742-9b32-570addb0ea77 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:47.188782 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7e80f398-3cda-4742-9b32-570addb0ea77 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:47.189212 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7e80f398-3cda-4742-9b32-570addb0ea77 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:47.189647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7e80f398-3cda-4742-9b32-570addb0ea77 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:47.252301 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7e80f398-3cda-4742-9b32-570addb0ea77 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:47.260306 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7e80f398-3cda-4742-9b32-570addb0ea77 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1267 microversion: 2.1 time: 0.084098 Jul 25 08:49:47.260831 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 230/499] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:47 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:48.040654 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f2451805-3312-4824-ad99-950eda95c3ce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fcaa51f-5a2a-499e-9d0e-2784446f64f6", "device": "/dev/sdb"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:49:48.043746 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f2451805-3312-4824-ad99-950eda95c3ce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:48.050930 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f2451805-3312-4824-ad99-950eda95c3ce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:48.051698 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f2451805-3312-4824-ad99-950eda95c3ce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:48.052681 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f2451805-3312-4824-ad99-950eda95c3ce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:48.053118 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f2451805-3312-4824-ad99-950eda95c3ce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:48.196885 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f66959c4-9439-47ba-a62d-15d4d3e2e9fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:48.197421 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f66959c4-9439-47ba-a62d-15d4d3e2e9fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:48.204424 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f66959c4-9439-47ba-a62d-15d4d3e2e9fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:48.204918 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f66959c4-9439-47ba-a62d-15d4d3e2e9fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:48.206045 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f66959c4-9439-47ba-a62d-15d4d3e2e9fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:48.206548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f66959c4-9439-47ba-a62d-15d4d3e2e9fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:48.336539 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f66959c4-9439-47ba-a62d-15d4d3e2e9fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:48.343945 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f66959c4-9439-47ba-a62d-15d4d3e2e9fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.151918 Jul 25 08:49:48.344508 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 231/500] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:48 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:48.348828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9070d02d-872a-4b92-a53d-11b3b7b134cf tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:48.349438 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9070d02d-872a-4b92-a53d-11b3b7b134cf tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:48.354965 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9070d02d-872a-4b92-a53d-11b3b7b134cf tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:48.355416 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9070d02d-872a-4b92-a53d-11b3b7b134cf tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:48.356180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9070d02d-872a-4b92-a53d-11b3b7b134cf tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:48.356629 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9070d02d-872a-4b92-a53d-11b3b7b134cf tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:48.482370 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9070d02d-872a-4b92-a53d-11b3b7b134cf tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:48.490339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9070d02d-872a-4b92-a53d-11b3b7b134cf tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.144875 Jul 25 08:49:48.490906 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 232/501] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:48 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:48.495181 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9c2b1f7a-df07-4277-8174-b854bbed6241 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:48.495780 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9c2b1f7a-df07-4277-8174-b854bbed6241 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:48.501277 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c2b1f7a-df07-4277-8174-b854bbed6241 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:48.501763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c2b1f7a-df07-4277-8174-b854bbed6241 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:48.502526 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c2b1f7a-df07-4277-8174-b854bbed6241 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:48.502967 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c2b1f7a-df07-4277-8174-b854bbed6241 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:48.564434 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9c2b1f7a-df07-4277-8174-b854bbed6241 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:48.572004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9c2b1f7a-df07-4277-8174-b854bbed6241 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1267 microversion: 2.1 time: 0.080162 Jul 25 08:49:48.572565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 233/502] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:48 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:49.364744 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f628a1ec-faa8-4378-8fe6-d98b22facfa2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:49.365361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f628a1ec-faa8-4378-8fe6-d98b22facfa2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:49.371796 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f628a1ec-faa8-4378-8fe6-d98b22facfa2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:49.372249 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f628a1ec-faa8-4378-8fe6-d98b22facfa2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:49.373039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f628a1ec-faa8-4378-8fe6-d98b22facfa2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:49.373473 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f628a1ec-faa8-4378-8fe6-d98b22facfa2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:49.511995 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f628a1ec-faa8-4378-8fe6-d98b22facfa2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:49.521653 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f628a1ec-faa8-4378-8fe6-d98b22facfa2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.160710 Jul 25 08:49:49.522337 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 234/503] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:49 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:49.527257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-101ee993-6f24-4dd8-9283-a6159d343ab8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:49.528062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-101ee993-6f24-4dd8-9283-a6159d343ab8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:49.533825 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-101ee993-6f24-4dd8-9283-a6159d343ab8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:49.534376 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-101ee993-6f24-4dd8-9283-a6159d343ab8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:49.535391 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-101ee993-6f24-4dd8-9283-a6159d343ab8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:49.535918 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-101ee993-6f24-4dd8-9283-a6159d343ab8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:49.670197 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-101ee993-6f24-4dd8-9283-a6159d343ab8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:49.678178 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-101ee993-6f24-4dd8-9283-a6159d343ab8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.154522 Jul 25 08:49:49.678733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 235/504] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:49 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:49.683002 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f1a3e4dd-b9c5-41cd-ad7f-edef8f56d27a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:49.683598 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f1a3e4dd-b9c5-41cd-ad7f-edef8f56d27a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:49.689680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1a3e4dd-b9c5-41cd-ad7f-edef8f56d27a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:49.690133 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1a3e4dd-b9c5-41cd-ad7f-edef8f56d27a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:49.690889 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1a3e4dd-b9c5-41cd-ad7f-edef8f56d27a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:49.691321 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1a3e4dd-b9c5-41cd-ad7f-edef8f56d27a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:49.749750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f1a3e4dd-b9c5-41cd-ad7f-edef8f56d27a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:49.757886 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f1a3e4dd-b9c5-41cd-ad7f-edef8f56d27a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1267 microversion: 2.1 time: 0.078223 Jul 25 08:49:49.758446 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 236/505] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:49 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1267 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:50.541526 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5c3bb487-4ad5-43ec-b904-b1fa90b93574 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:50.542173 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5c3bb487-4ad5-43ec-b904-b1fa90b93574 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:50.548439 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c3bb487-4ad5-43ec-b904-b1fa90b93574 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:50.548925 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c3bb487-4ad5-43ec-b904-b1fa90b93574 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:50.549694 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c3bb487-4ad5-43ec-b904-b1fa90b93574 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:50.550138 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5c3bb487-4ad5-43ec-b904-b1fa90b93574 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:50.734993 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5c3bb487-4ad5-43ec-b904-b1fa90b93574 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:50.745220 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5c3bb487-4ad5-43ec-b904-b1fa90b93574 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.207280 Jul 25 08:49:50.746380 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 237/506] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:50 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:50.752534 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a7bb5798-c00a-4792-9c0a-2434821b3e3d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:50.753393 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a7bb5798-c00a-4792-9c0a-2434821b3e3d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:50.760433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a7bb5798-c00a-4792-9c0a-2434821b3e3d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:50.761132 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a7bb5798-c00a-4792-9c0a-2434821b3e3d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:50.762062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a7bb5798-c00a-4792-9c0a-2434821b3e3d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:50.762639 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a7bb5798-c00a-4792-9c0a-2434821b3e3d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:50.969721 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a7bb5798-c00a-4792-9c0a-2434821b3e3d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:50.977074 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a7bb5798-c00a-4792-9c0a-2434821b3e3d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.229412 Jul 25 08:49:50.977644 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 238/507] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:50 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:50.994894 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-83a080ad-b237-401d-acf7-4ecf32db3adc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:50.995523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-83a080ad-b237-401d-acf7-4ecf32db3adc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:51.002153 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-83a080ad-b237-401d-acf7-4ecf32db3adc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:51.002602 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-83a080ad-b237-401d-acf7-4ecf32db3adc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:51.003364 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-83a080ad-b237-401d-acf7-4ecf32db3adc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:51.003951 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-83a080ad-b237-401d-acf7-4ecf32db3adc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:51.071690 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-83a080ad-b237-401d-acf7-4ecf32db3adc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:51.080807 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-83a080ad-b237-401d-acf7-4ecf32db3adc tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1273 microversion: 2.1 time: 0.102097 Jul 25 08:49:51.081522 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 239/508] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:50 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:51.088242 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f2451805-3312-4824-ad99-950eda95c3ce tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "POST /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.051332 Jul 25 08:49:51.089019 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 270/509] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:49:48 2022] POST /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530/os-volume_attachments => generated 194 bytes in 3053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:49:51.766018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e3622385-8a19-495e-8dee-f64e88448a8d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:51.766634 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e3622385-8a19-495e-8dee-f64e88448a8d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:51.774748 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3622385-8a19-495e-8dee-f64e88448a8d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:51.775566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3622385-8a19-495e-8dee-f64e88448a8d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:51.776353 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3622385-8a19-495e-8dee-f64e88448a8d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:51.776835 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3622385-8a19-495e-8dee-f64e88448a8d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:51.919498 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e3622385-8a19-495e-8dee-f64e88448a8d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:51.926950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e3622385-8a19-495e-8dee-f64e88448a8d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.164775 Jul 25 08:49:51.927509 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 240/510] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:51 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:51.998212 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9c08d619-2889-4316-a1a1-323417f62afa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:51.998900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9c08d619-2889-4316-a1a1-323417f62afa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:52.005682 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9c08d619-2889-4316-a1a1-323417f62afa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:52.006121 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9c08d619-2889-4316-a1a1-323417f62afa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:52.006877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9c08d619-2889-4316-a1a1-323417f62afa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:52.007313 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9c08d619-2889-4316-a1a1-323417f62afa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:52.102525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-807a9b7c-86a6-4ab7-9469-58f934248faa tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:52.103154 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-807a9b7c-86a6-4ab7-9469-58f934248faa tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:52.110327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-807a9b7c-86a6-4ab7-9469-58f934248faa tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:52.110779 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-807a9b7c-86a6-4ab7-9469-58f934248faa tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:52.111618 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-807a9b7c-86a6-4ab7-9469-58f934248faa tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:52.112082 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-807a9b7c-86a6-4ab7-9469-58f934248faa tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:52.147205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9c08d619-2889-4316-a1a1-323417f62afa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:52.155039 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9c08d619-2889-4316-a1a1-323417f62afa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.161189 Jul 25 08:49:52.155736 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 271/511] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:51 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:52.177373 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-807a9b7c-86a6-4ab7-9469-58f934248faa tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:52.184847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-807a9b7c-86a6-4ab7-9469-58f934248faa tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1273 microversion: 2.1 time: 0.086376 Jul 25 08:49:52.185421 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 241/512] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:52 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:52.947279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cdfec264-ab06-4d3b-8326-d32d9d7432ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:52.947894 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cdfec264-ab06-4d3b-8326-d32d9d7432ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:52.954522 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cdfec264-ab06-4d3b-8326-d32d9d7432ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:52.954982 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cdfec264-ab06-4d3b-8326-d32d9d7432ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:52.955786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cdfec264-ab06-4d3b-8326-d32d9d7432ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:52.956223 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cdfec264-ab06-4d3b-8326-d32d9d7432ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:53.083585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cdfec264-ab06-4d3b-8326-d32d9d7432ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:53.090932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cdfec264-ab06-4d3b-8326-d32d9d7432ef tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.147624 Jul 25 08:49:53.091499 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 272/513] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:52 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:53.175769 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bd3ff0bd-042c-4501-bd8a-e3c8ac0218a3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:53.176372 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bd3ff0bd-042c-4501-bd8a-e3c8ac0218a3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:53.182914 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd3ff0bd-042c-4501-bd8a-e3c8ac0218a3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:53.183359 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd3ff0bd-042c-4501-bd8a-e3c8ac0218a3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:53.184106 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd3ff0bd-042c-4501-bd8a-e3c8ac0218a3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:53.184534 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd3ff0bd-042c-4501-bd8a-e3c8ac0218a3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:53.206541 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0b00608d-47ed-4c0f-a2fc-516ad4032911 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:53.207083 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0b00608d-47ed-4c0f-a2fc-516ad4032911 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:53.213237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b00608d-47ed-4c0f-a2fc-516ad4032911 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:53.213691 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b00608d-47ed-4c0f-a2fc-516ad4032911 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:53.214460 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b00608d-47ed-4c0f-a2fc-516ad4032911 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:53.214897 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b00608d-47ed-4c0f-a2fc-516ad4032911 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:53.293918 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0b00608d-47ed-4c0f-a2fc-516ad4032911 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:53.302809 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0b00608d-47ed-4c0f-a2fc-516ad4032911 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1273 microversion: 2.1 time: 0.100057 Jul 25 08:49:53.303395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 273/514] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:53 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:53.343869 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bd3ff0bd-042c-4501-bd8a-e3c8ac0218a3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:53.351877 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bd3ff0bd-042c-4501-bd8a-e3c8ac0218a3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.180551 Jul 25 08:49:53.352449 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 242/515] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:53 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:54.111549 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-011cd549-9910-40a4-87a2-8823dcec6c48 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:54.112155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-011cd549-9910-40a4-87a2-8823dcec6c48 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:54.118583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-011cd549-9910-40a4-87a2-8823dcec6c48 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:54.119122 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-011cd549-9910-40a4-87a2-8823dcec6c48 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:54.120038 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-011cd549-9910-40a4-87a2-8823dcec6c48 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:54.120609 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-011cd549-9910-40a4-87a2-8823dcec6c48 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:54.259145 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-011cd549-9910-40a4-87a2-8823dcec6c48 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:54.266455 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-011cd549-9910-40a4-87a2-8823dcec6c48 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.159238 Jul 25 08:49:54.267013 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 274/516] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:54 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:54.323084 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-148e6282-b4b7-4242-9b3f-dc2bc4dfabbe tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:54.323706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-148e6282-b4b7-4242-9b3f-dc2bc4dfabbe tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:54.330270 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-148e6282-b4b7-4242-9b3f-dc2bc4dfabbe tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:54.330707 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-148e6282-b4b7-4242-9b3f-dc2bc4dfabbe tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:54.331502 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-148e6282-b4b7-4242-9b3f-dc2bc4dfabbe tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:54.331948 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-148e6282-b4b7-4242-9b3f-dc2bc4dfabbe tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:54.373969 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cd6c31fd-555a-4fbc-9f23-2fc5c1eb59fb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:54.374631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cd6c31fd-555a-4fbc-9f23-2fc5c1eb59fb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:54.381542 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd6c31fd-555a-4fbc-9f23-2fc5c1eb59fb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:54.382012 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd6c31fd-555a-4fbc-9f23-2fc5c1eb59fb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:54.382768 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd6c31fd-555a-4fbc-9f23-2fc5c1eb59fb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:54.383205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd6c31fd-555a-4fbc-9f23-2fc5c1eb59fb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:54.395784 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-148e6282-b4b7-4242-9b3f-dc2bc4dfabbe tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:54.404176 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-148e6282-b4b7-4242-9b3f-dc2bc4dfabbe tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1273 microversion: 2.1 time: 0.084907 Jul 25 08:49:54.405002 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 243/517] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:54 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:54.515772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cd6c31fd-555a-4fbc-9f23-2fc5c1eb59fb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:54.523041 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cd6c31fd-555a-4fbc-9f23-2fc5c1eb59fb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.152895 Jul 25 08:49:54.523601 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 275/518] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:54 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:55.286693 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0c1c4290-c4af-4fbc-bf14-989c8eb079f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:55.287250 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0c1c4290-c4af-4fbc-bf14-989c8eb079f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:55.293258 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0c1c4290-c4af-4fbc-bf14-989c8eb079f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:55.293780 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0c1c4290-c4af-4fbc-bf14-989c8eb079f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:55.294541 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0c1c4290-c4af-4fbc-bf14-989c8eb079f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:55.294973 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0c1c4290-c4af-4fbc-bf14-989c8eb079f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:55.298997 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:55.425013 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-276069d7-0de3-43e9-9795-2a0bb3893d5c tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:55.425762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-276069d7-0de3-43e9-9795-2a0bb3893d5c tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:55.429593 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0c1c4290-c4af-4fbc-bf14-989c8eb079f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:55.432431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-276069d7-0de3-43e9-9795-2a0bb3893d5c tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:55.432916 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-276069d7-0de3-43e9-9795-2a0bb3893d5c tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:55.435503 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-276069d7-0de3-43e9-9795-2a0bb3893d5c tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:55.435958 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-276069d7-0de3-43e9-9795-2a0bb3893d5c tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:55.439333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0c1c4290-c4af-4fbc-bf14-989c8eb079f8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.155810 Jul 25 08:49:55.440617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 244/519] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:55 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:55.509112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-276069d7-0de3-43e9-9795-2a0bb3893d5c tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:55.517045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-276069d7-0de3-43e9-9795-2a0bb3893d5c tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1273 microversion: 2.1 time: 0.095312 Jul 25 08:49:55.517613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 276/520] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:55 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:55.543063 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fca562ab-8a4e-434b-82d2-e6301f1e51c8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:55.543622 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fca562ab-8a4e-434b-82d2-e6301f1e51c8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:55.550146 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fca562ab-8a4e-434b-82d2-e6301f1e51c8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:55.550600 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fca562ab-8a4e-434b-82d2-e6301f1e51c8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:55.551359 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fca562ab-8a4e-434b-82d2-e6301f1e51c8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:55.551797 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fca562ab-8a4e-434b-82d2-e6301f1e51c8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:55.680692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fca562ab-8a4e-434b-82d2-e6301f1e51c8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:55.688009 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fca562ab-8a4e-434b-82d2-e6301f1e51c8 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.148831 Jul 25 08:49:55.689231 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 245/521] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:55 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:56.459014 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aa9f2a4e-d92f-4940-a56a-bc5d99376c4e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:56.459619 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-aa9f2a4e-d92f-4940-a56a-bc5d99376c4e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:56.465966 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa9f2a4e-d92f-4940-a56a-bc5d99376c4e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:56.466411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa9f2a4e-d92f-4940-a56a-bc5d99376c4e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:56.467162 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa9f2a4e-d92f-4940-a56a-bc5d99376c4e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:56.467594 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa9f2a4e-d92f-4940-a56a-bc5d99376c4e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:56.538423 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ec25022d-4df0-4e6f-9d7a-d2d44ce28009 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:56.539166 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ec25022d-4df0-4e6f-9d7a-d2d44ce28009 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:56.549288 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ec25022d-4df0-4e6f-9d7a-d2d44ce28009 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:56.549958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ec25022d-4df0-4e6f-9d7a-d2d44ce28009 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:56.550946 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ec25022d-4df0-4e6f-9d7a-d2d44ce28009 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:56.551573 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ec25022d-4df0-4e6f-9d7a-d2d44ce28009 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:56.610151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-aa9f2a4e-d92f-4940-a56a-bc5d99376c4e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:56.618249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-aa9f2a4e-d92f-4940-a56a-bc5d99376c4e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.162955 Jul 25 08:49:56.618892 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 277/522] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:56 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:56.626534 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ec25022d-4df0-4e6f-9d7a-d2d44ce28009 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:56.634338 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ec25022d-4df0-4e6f-9d7a-d2d44ce28009 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1273 microversion: 2.1 time: 0.100539 Jul 25 08:49:56.634890 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 246/523] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:56 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:56.709605 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f3404494-ceb5-4905-b2ec-ddd79c064e9f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:56.710138 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f3404494-ceb5-4905-b2ec-ddd79c064e9f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:56.715990 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f3404494-ceb5-4905-b2ec-ddd79c064e9f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:56.716434 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f3404494-ceb5-4905-b2ec-ddd79c064e9f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:56.717221 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f3404494-ceb5-4905-b2ec-ddd79c064e9f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:56.717650 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f3404494-ceb5-4905-b2ec-ddd79c064e9f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:56.842174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f3404494-ceb5-4905-b2ec-ddd79c064e9f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:56.849629 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f3404494-ceb5-4905-b2ec-ddd79c064e9f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.143824 Jul 25 08:49:56.850196 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 278/524] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:56 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:57.639307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-67a034aa-f004-4801-89ba-d934d945b541 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:57.640126 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-67a034aa-f004-4801-89ba-d934d945b541 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:57.646511 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67a034aa-f004-4801-89ba-d934d945b541 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:57.646971 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67a034aa-f004-4801-89ba-d934d945b541 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:57.647739 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67a034aa-f004-4801-89ba-d934d945b541 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:57.648185 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67a034aa-f004-4801-89ba-d934d945b541 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:57.656767 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4a79374f-6363-4a12-a05e-d7972d692c85 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:57.657876 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4a79374f-6363-4a12-a05e-d7972d692c85 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:57.664713 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4a79374f-6363-4a12-a05e-d7972d692c85 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:57.665281 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4a79374f-6363-4a12-a05e-d7972d692c85 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:57.666107 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4a79374f-6363-4a12-a05e-d7972d692c85 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:57.666754 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4a79374f-6363-4a12-a05e-d7972d692c85 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:57.747080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4a79374f-6363-4a12-a05e-d7972d692c85 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:57.754622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4a79374f-6363-4a12-a05e-d7972d692c85 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1273 microversion: 2.1 time: 0.103103 Jul 25 08:49:57.755456 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 279/525] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:57 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:57.803519 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-67a034aa-f004-4801-89ba-d934d945b541 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:57.810887 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-67a034aa-f004-4801-89ba-d934d945b541 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.175625 Jul 25 08:49:57.811453 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 247/526] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:57 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:57.870126 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-32b8e36d-cd26-4ac4-8a74-bcf56d05d44c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:57.870737 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-32b8e36d-cd26-4ac4-8a74-bcf56d05d44c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:57.876971 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32b8e36d-cd26-4ac4-8a74-bcf56d05d44c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:57.877638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32b8e36d-cd26-4ac4-8a74-bcf56d05d44c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:57.878400 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32b8e36d-cd26-4ac4-8a74-bcf56d05d44c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:57.879709 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32b8e36d-cd26-4ac4-8a74-bcf56d05d44c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:58.012227 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-32b8e36d-cd26-4ac4-8a74-bcf56d05d44c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:58.018000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-09b27a0a-73ef-4b67-a2b8-9a216e8ec4fe req-4b58e580-9766-4f89-8678-e51b3937e772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d", "name": "network-vif-plugged", "status": "completed", "tag": "39973804-976f-4223-a900-f8cbbe4dcd0e"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:49:58.019548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-32b8e36d-cd26-4ac4-8a74-bcf56d05d44c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.153295 Jul 25 08:49:58.020410 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 280/527] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:57 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:58.031559 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-09b27a0a-73ef-4b67-a2b8-9a216e8ec4fe req-4b58e580-9766-4f89-8678-e51b3937e772 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:58.032112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-09b27a0a-73ef-4b67-a2b8-9a216e8ec4fe req-4b58e580-9766-4f89-8678-e51b3937e772 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:58.043893 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-09b27a0a-73ef-4b67-a2b8-9a216e8ec4fe req-4b58e580-9766-4f89-8678-e51b3937e772 service nova] Creating event network-vif-plugged:39973804-976f-4223-a900-f8cbbe4dcd0e for instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d on hv-cinder-85084 Jul 25 08:49:58.050455 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-09b27a0a-73ef-4b67-a2b8-9a216e8ec4fe req-4b58e580-9766-4f89-8678-e51b3937e772 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035891 Jul 25 08:49:58.051037 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 248/528] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:49:58.775424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f4df841e-b0fa-40ae-a8ed-891984372a7d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:58.776053 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f4df841e-b0fa-40ae-a8ed-891984372a7d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:58.782024 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4df841e-b0fa-40ae-a8ed-891984372a7d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:58.782465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4df841e-b0fa-40ae-a8ed-891984372a7d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:58.783217 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4df841e-b0fa-40ae-a8ed-891984372a7d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:58.783644 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4df841e-b0fa-40ae-a8ed-891984372a7d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:58.832500 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dcc7cf3d-0800-45ed-ad10-19920868a5fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:58.833273 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dcc7cf3d-0800-45ed-ad10-19920868a5fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:58.839780 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcc7cf3d-0800-45ed-ad10-19920868a5fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:58.840228 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcc7cf3d-0800-45ed-ad10-19920868a5fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:58.841022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcc7cf3d-0800-45ed-ad10-19920868a5fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:58.841594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dcc7cf3d-0800-45ed-ad10-19920868a5fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:58.851594 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f4df841e-b0fa-40ae-a8ed-891984372a7d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:58.858994 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f4df841e-b0fa-40ae-a8ed-891984372a7d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1273 microversion: 2.1 time: 0.087626 Jul 25 08:49:58.859563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 281/529] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:58 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:59.001191 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dcc7cf3d-0800-45ed-ad10-19920868a5fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:59.009048 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dcc7cf3d-0800-45ed-ad10-19920868a5fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.181353 Jul 25 08:49:59.009928 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 249/530] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:58 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:49:59.040975 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3a8469f2-e2bf-494d-991b-9577cc75eb1c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:59.041495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3a8469f2-e2bf-494d-991b-9577cc75eb1c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:59.048611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3a8469f2-e2bf-494d-991b-9577cc75eb1c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:59.049283 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3a8469f2-e2bf-494d-991b-9577cc75eb1c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:59.050055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3a8469f2-e2bf-494d-991b-9577cc75eb1c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:59.050670 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3a8469f2-e2bf-494d-991b-9577cc75eb1c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:59.237127 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3a8469f2-e2bf-494d-991b-9577cc75eb1c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:49:59.240933 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:49:59.245801 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3a8469f2-e2bf-494d-991b-9577cc75eb1c tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.208949 Jul 25 08:49:59.246451 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 282/531] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:59 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:49:59.880564 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fa4ea262-d75c-4797-a043-f2c98cc01245 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:49:59.881914 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fa4ea262-d75c-4797-a043-f2c98cc01245 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:49:59.894391 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fa4ea262-d75c-4797-a043-f2c98cc01245 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:59.895171 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fa4ea262-d75c-4797-a043-f2c98cc01245 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:49:59.896194 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fa4ea262-d75c-4797-a043-f2c98cc01245 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:49:59.896873 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fa4ea262-d75c-4797-a043-f2c98cc01245 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:00.033244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-59f04be7-a30e-4254-aa3c-a0fbbc0a48b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:00.035397 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-59f04be7-a30e-4254-aa3c-a0fbbc0a48b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:00.045514 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-59f04be7-a30e-4254-aa3c-a0fbbc0a48b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:00.046249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-59f04be7-a30e-4254-aa3c-a0fbbc0a48b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:00.049209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-59f04be7-a30e-4254-aa3c-a0fbbc0a48b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:00.050030 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-59f04be7-a30e-4254-aa3c-a0fbbc0a48b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:00.061671 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fa4ea262-d75c-4797-a043-f2c98cc01245 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:00.072607 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fa4ea262-d75c-4797-a043-f2c98cc01245 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.196838 Jul 25 08:50:00.073187 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 250/532] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:49:59 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:00.209345 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-59f04be7-a30e-4254-aa3c-a0fbbc0a48b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:00.217195 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-59f04be7-a30e-4254-aa3c-a0fbbc0a48b3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1371 microversion: 2.1 time: 0.190037 Jul 25 08:50:00.218273 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 283/533] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:00 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:00.270910 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ca12da20-c61e-46c3-8c9f-fba1e58d10e3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:00.271527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ca12da20-c61e-46c3-8c9f-fba1e58d10e3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:00.277735 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca12da20-c61e-46c3-8c9f-fba1e58d10e3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:00.278453 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca12da20-c61e-46c3-8c9f-fba1e58d10e3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:00.279222 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca12da20-c61e-46c3-8c9f-fba1e58d10e3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:00.279857 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca12da20-c61e-46c3-8c9f-fba1e58d10e3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:00.431628 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ca12da20-c61e-46c3-8c9f-fba1e58d10e3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:00.436824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-ab6febda-b7c5-44df-a93e-601d435f046e req-fe94c877-e60f-4198-85b2-f7d59216275a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6", "tag": "f1ce2b2c-18a9-4cb3-9155-7b6d45a03700"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:00.441338 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ca12da20-c61e-46c3-8c9f-fba1e58d10e3 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.174817 Jul 25 08:50:00.441930 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 251/534] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:00 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:00.448817 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ab6febda-b7c5-44df-a93e-601d435f046e req-fe94c877-e60f-4198-85b2-f7d59216275a service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:00.449268 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ab6febda-b7c5-44df-a93e-601d435f046e req-fe94c877-e60f-4198-85b2-f7d59216275a service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:00.461788 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-ab6febda-b7c5-44df-a93e-601d435f046e req-fe94c877-e60f-4198-85b2-f7d59216275a service nova] Creating event network-changed:f1ce2b2c-18a9-4cb3-9155-7b6d45a03700 for instance e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 on hv-cinder-85084 Jul 25 08:50:00.466704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-ab6febda-b7c5-44df-a93e-601d435f046e req-fe94c877-e60f-4198-85b2-f7d59216275a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034434 Jul 25 08:50:00.467310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 284/535] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:50:01.093037 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-15518e42-fd7f-46b7-99fe-952dce68d8ed tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:01.093641 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-15518e42-fd7f-46b7-99fe-952dce68d8ed tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:01.100847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-15518e42-fd7f-46b7-99fe-952dce68d8ed tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:01.101333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-15518e42-fd7f-46b7-99fe-952dce68d8ed tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:01.102225 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-15518e42-fd7f-46b7-99fe-952dce68d8ed tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:01.102665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-15518e42-fd7f-46b7-99fe-952dce68d8ed tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:01.237882 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-15518e42-fd7f-46b7-99fe-952dce68d8ed tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:01.239253 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-40c55540-4189-42c2-8f25-c5db55492539 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:01.240186 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-40c55540-4189-42c2-8f25-c5db55492539 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:01.245525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-15518e42-fd7f-46b7-99fe-952dce68d8ed tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.156688 Jul 25 08:50:01.246095 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 252/536] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:01 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:01.246581 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-40c55540-4189-42c2-8f25-c5db55492539 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:01.247034 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-40c55540-4189-42c2-8f25-c5db55492539 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:01.247807 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-40c55540-4189-42c2-8f25-c5db55492539 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:01.248243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-40c55540-4189-42c2-8f25-c5db55492539 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:01.376915 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-40c55540-4189-42c2-8f25-c5db55492539 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:01.384430 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-40c55540-4189-42c2-8f25-c5db55492539 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1566 microversion: 2.1 time: 0.149810 Jul 25 08:50:01.385015 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 285/537] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:01 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:01.404160 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6d091542-eef0-453f-af03-d48f9d6fefd4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:01.404731 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6d091542-eef0-453f-af03-d48f9d6fefd4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:01.410727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6d091542-eef0-453f-af03-d48f9d6fefd4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:01.411182 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6d091542-eef0-453f-af03-d48f9d6fefd4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:01.411947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6d091542-eef0-453f-af03-d48f9d6fefd4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:01.412402 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6d091542-eef0-453f-af03-d48f9d6fefd4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:01.466923 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3653b423-6120-43ad-ba45-5fe4ce813c1a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:01.467832 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3653b423-6120-43ad-ba45-5fe4ce813c1a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:01.474235 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3653b423-6120-43ad-ba45-5fe4ce813c1a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:01.474765 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3653b423-6120-43ad-ba45-5fe4ce813c1a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:01.475648 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3653b423-6120-43ad-ba45-5fe4ce813c1a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:01.476134 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3653b423-6120-43ad-ba45-5fe4ce813c1a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:01.495549 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6d091542-eef0-453f-af03-d48f9d6fefd4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095166 Jul 25 08:50:01.496159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 253/538] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Jul 25 08:50:01 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:50:01.752685 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3653b423-6120-43ad-ba45-5fe4ce813c1a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:01.761810 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3653b423-6120-43ad-ba45-5fe4ce813c1a tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.299376 Jul 25 08:50:01.762663 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 286/539] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:01 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:02.242897 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-9de5dbbf-cee8-4a0c-ac93-397f41926c0c req-0e83cead-2dca-48ee-88de-ac432a181958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d74c6940-419a-4a70-bc74-9e4536cf9805", "name": "network-vif-plugged", "status": "completed", "tag": "c243097a-4313-4fd5-ad41-f6f18a03b006"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:02.263392 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-9de5dbbf-cee8-4a0c-ac93-397f41926c0c req-0e83cead-2dca-48ee-88de-ac432a181958 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:02.263837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-9de5dbbf-cee8-4a0c-ac93-397f41926c0c req-0e83cead-2dca-48ee-88de-ac432a181958 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:02.267657 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3d5fc7ee-5e57-448b-bd1b-0c0be16a4a26 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:02.268203 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3d5fc7ee-5e57-448b-bd1b-0c0be16a4a26 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:02.282973 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d5fc7ee-5e57-448b-bd1b-0c0be16a4a26 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:02.284234 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d5fc7ee-5e57-448b-bd1b-0c0be16a4a26 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:02.287027 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d5fc7ee-5e57-448b-bd1b-0c0be16a4a26 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:02.289689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d5fc7ee-5e57-448b-bd1b-0c0be16a4a26 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:02.298367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-9de5dbbf-cee8-4a0c-ac93-397f41926c0c req-0e83cead-2dca-48ee-88de-ac432a181958 service nova] Creating event network-vif-plugged:c243097a-4313-4fd5-ad41-f6f18a03b006 for instance d74c6940-419a-4a70-bc74-9e4536cf9805 on hv-cinder-85084 Jul 25 08:50:02.316013 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-9de5dbbf-cee8-4a0c-ac93-397f41926c0c req-0e83cead-2dca-48ee-88de-ac432a181958 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077103 Jul 25 08:50:02.321030 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 254/540] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:50:02.587132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3d5fc7ee-5e57-448b-bd1b-0c0be16a4a26 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:02.594517 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3d5fc7ee-5e57-448b-bd1b-0c0be16a4a26 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.331646 Jul 25 08:50:02.595103 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 287/541] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:02 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:02.783862 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3463c777-3fbf-4ea8-9131-09b2d3e21c37 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:02.784846 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3463c777-3fbf-4ea8-9131-09b2d3e21c37 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:02.791385 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3463c777-3fbf-4ea8-9131-09b2d3e21c37 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:02.792769 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3463c777-3fbf-4ea8-9131-09b2d3e21c37 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:02.794124 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3463c777-3fbf-4ea8-9131-09b2d3e21c37 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:02.795287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3463c777-3fbf-4ea8-9131-09b2d3e21c37 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:03.017451 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3463c777-3fbf-4ea8-9131-09b2d3e21c37 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:03.020767 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-90bd35e7-9d8b-4ec6-87d6-d9ce5f633d2e req-3c9cd7b7-24b2-4fe2-aed3-929552b3a290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d", "tag": "39973804-976f-4223-a900-f8cbbe4dcd0e"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:03.030789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-90bd35e7-9d8b-4ec6-87d6-d9ce5f633d2e req-3c9cd7b7-24b2-4fe2-aed3-929552b3a290 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:03.031342 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3463c777-3fbf-4ea8-9131-09b2d3e21c37 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.252392 Jul 25 08:50:03.031877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-90bd35e7-9d8b-4ec6-87d6-d9ce5f633d2e req-3c9cd7b7-24b2-4fe2-aed3-929552b3a290 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:03.033861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 255/542] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:02 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:03.043399 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-90bd35e7-9d8b-4ec6-87d6-d9ce5f633d2e req-3c9cd7b7-24b2-4fe2-aed3-929552b3a290 service nova] Creating event network-changed:39973804-976f-4223-a900-f8cbbe4dcd0e for instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d on hv-cinder-85084 Jul 25 08:50:03.048886 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-90bd35e7-9d8b-4ec6-87d6-d9ce5f633d2e req-3c9cd7b7-24b2-4fe2-aed3-929552b3a290 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031759 Jul 25 08:50:03.050157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 288/543] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:50:03.614797 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-48cbfc2f-91b2-40f8-990f-02cf2779d1ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:03.615433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-48cbfc2f-91b2-40f8-990f-02cf2779d1ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:03.622069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-48cbfc2f-91b2-40f8-990f-02cf2779d1ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:03.622517 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-48cbfc2f-91b2-40f8-990f-02cf2779d1ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:03.623304 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-48cbfc2f-91b2-40f8-990f-02cf2779d1ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:03.623731 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-48cbfc2f-91b2-40f8-990f-02cf2779d1ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:03.978036 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-48cbfc2f-91b2-40f8-990f-02cf2779d1ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:03.986275 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-48cbfc2f-91b2-40f8-990f-02cf2779d1ef tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.375236 Jul 25 08:50:03.988603 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 256/544] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:03 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:04.054520 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aabd9b83-7861-4658-bc64-6dc5ea570f05 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:04.055231 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-aabd9b83-7861-4658-bc64-6dc5ea570f05 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:04.064690 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aabd9b83-7861-4658-bc64-6dc5ea570f05 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:04.065348 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aabd9b83-7861-4658-bc64-6dc5ea570f05 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:04.066140 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aabd9b83-7861-4658-bc64-6dc5ea570f05 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:04.066584 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aabd9b83-7861-4658-bc64-6dc5ea570f05 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:04.202563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-aabd9b83-7861-4658-bc64-6dc5ea570f05 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:04.210050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-aabd9b83-7861-4658-bc64-6dc5ea570f05 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.160193 Jul 25 08:50:04.210616 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 289/545] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:04 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:05.006789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-38b5140d-9a73-4382-8c79-a17b3b6907da tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:05.007398 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-38b5140d-9a73-4382-8c79-a17b3b6907da tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:05.014270 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-38b5140d-9a73-4382-8c79-a17b3b6907da tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:05.014719 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-38b5140d-9a73-4382-8c79-a17b3b6907da tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:05.015550 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-38b5140d-9a73-4382-8c79-a17b3b6907da tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:05.015992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-38b5140d-9a73-4382-8c79-a17b3b6907da tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:05.145710 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-38b5140d-9a73-4382-8c79-a17b3b6907da tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:05.153186 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-38b5140d-9a73-4382-8c79-a17b3b6907da tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.150386 Jul 25 08:50:05.153749 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 257/546] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:05 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:05.230763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0df533a1-864a-4f0f-9148-ea0f30eb973d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:05.231423 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0df533a1-864a-4f0f-9148-ea0f30eb973d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:05.237863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0df533a1-864a-4f0f-9148-ea0f30eb973d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:05.238329 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0df533a1-864a-4f0f-9148-ea0f30eb973d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:05.239075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0df533a1-864a-4f0f-9148-ea0f30eb973d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:05.239506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0df533a1-864a-4f0f-9148-ea0f30eb973d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:05.363500 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0df533a1-864a-4f0f-9148-ea0f30eb973d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:05.370980 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0df533a1-864a-4f0f-9148-ea0f30eb973d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.144039 Jul 25 08:50:05.371542 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 290/547] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:05 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:06.174727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1633ea7a-059d-4db4-85bf-254021273eff tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:06.175350 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1633ea7a-059d-4db4-85bf-254021273eff tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:06.181793 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1633ea7a-059d-4db4-85bf-254021273eff tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:06.182248 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1633ea7a-059d-4db4-85bf-254021273eff tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:06.183015 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1633ea7a-059d-4db4-85bf-254021273eff tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:06.183478 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1633ea7a-059d-4db4-85bf-254021273eff tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:06.332847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1633ea7a-059d-4db4-85bf-254021273eff tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:06.340259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1633ea7a-059d-4db4-85bf-254021273eff tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.169945 Jul 25 08:50:06.340882 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 258/548] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:06 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:06.392022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-21050162-a15e-4709-9527-a1d6ae4f00dd tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:06.392713 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-21050162-a15e-4709-9527-a1d6ae4f00dd tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:06.399271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-21050162-a15e-4709-9527-a1d6ae4f00dd tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:06.399715 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-21050162-a15e-4709-9527-a1d6ae4f00dd tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:06.400467 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-21050162-a15e-4709-9527-a1d6ae4f00dd tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:06.400919 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-21050162-a15e-4709-9527-a1d6ae4f00dd tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:06.528035 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-21050162-a15e-4709-9527-a1d6ae4f00dd tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:06.535294 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-21050162-a15e-4709-9527-a1d6ae4f00dd tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.147106 Jul 25 08:50:06.535856 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 291/549] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:06 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:07.361026 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8266fff3-6984-4022-a9c7-5283258cb6bb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:07.361643 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-8266fff3-6984-4022-a9c7-5283258cb6bb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:07.368087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8266fff3-6984-4022-a9c7-5283258cb6bb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:07.368536 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8266fff3-6984-4022-a9c7-5283258cb6bb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:07.369325 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8266fff3-6984-4022-a9c7-5283258cb6bb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:07.369770 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8266fff3-6984-4022-a9c7-5283258cb6bb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:07.498483 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8266fff3-6984-4022-a9c7-5283258cb6bb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:07.506189 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8266fff3-6984-4022-a9c7-5283258cb6bb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.149005 Jul 25 08:50:07.506754 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 259/550] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:07 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:07.555770 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3efd10b8-d0a9-4f41-9302-a683478ee9d6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:07.556403 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3efd10b8-d0a9-4f41-9302-a683478ee9d6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:07.562934 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3efd10b8-d0a9-4f41-9302-a683478ee9d6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:07.563878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3efd10b8-d0a9-4f41-9302-a683478ee9d6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:07.564673 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3efd10b8-d0a9-4f41-9302-a683478ee9d6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:07.565111 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3efd10b8-d0a9-4f41-9302-a683478ee9d6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:07.695572 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3efd10b8-d0a9-4f41-9302-a683478ee9d6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:07.703060 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3efd10b8-d0a9-4f41-9302-a683478ee9d6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.151125 Jul 25 08:50:07.703623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 292/551] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:07 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:08.288782 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-357ea4d1-b4d5-4e23-aa0f-d7ad1ef9e708 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:08.297837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-357ea4d1-b4d5-4e23-aa0f-d7ad1ef9e708 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:08.299309 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-357ea4d1-b4d5-4e23-aa0f-d7ad1ef9e708 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:08.361112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-357ea4d1-b4d5-4e23-aa0f-d7ad1ef9e708 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Going to try to stop instance {{(pid=124234) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 08:50:08.401804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-357ea4d1-b4d5-4e23-aa0f-d7ad1ef9e708 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/action" status: 202 len: 0 microversion: 2.1 time: 0.119856 Jul 25 08:50:08.402468 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 260/552] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:50:08 2022] POST /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:50:08.411022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6afe5dfe-7248-41f4-83ce-61021d313b4f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:08.411634 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6afe5dfe-7248-41f4-83ce-61021d313b4f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:08.421284 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6afe5dfe-7248-41f4-83ce-61021d313b4f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:08.422109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6afe5dfe-7248-41f4-83ce-61021d313b4f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:08.424133 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6afe5dfe-7248-41f4-83ce-61021d313b4f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:08.424979 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6afe5dfe-7248-41f4-83ce-61021d313b4f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:08.527666 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b839f2e3-fbf6-4abf-a51a-93a8c3a7c223 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:08.528615 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b839f2e3-fbf6-4abf-a51a-93a8c3a7c223 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:08.535690 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b839f2e3-fbf6-4abf-a51a-93a8c3a7c223 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:08.536139 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b839f2e3-fbf6-4abf-a51a-93a8c3a7c223 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:08.536919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b839f2e3-fbf6-4abf-a51a-93a8c3a7c223 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:08.537351 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b839f2e3-fbf6-4abf-a51a-93a8c3a7c223 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:08.556748 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:08.568364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6afe5dfe-7248-41f4-83ce-61021d313b4f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:08.577759 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6afe5dfe-7248-41f4-83ce-61021d313b4f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.170970 Jul 25 08:50:08.578433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 293/553] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:08 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:08.678834 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b839f2e3-fbf6-4abf-a51a-93a8c3a7c223 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:08.686152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b839f2e3-fbf6-4abf-a51a-93a8c3a7c223 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.162840 Jul 25 08:50:08.686775 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 261/554] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:08 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:08.725002 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c3abdb03-232c-4fcb-a5d6-52e444a4d47d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:08.725611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c3abdb03-232c-4fcb-a5d6-52e444a4d47d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:08.727537 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=51 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:08.733220 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3abdb03-232c-4fcb-a5d6-52e444a4d47d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:08.733670 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3abdb03-232c-4fcb-a5d6-52e444a4d47d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:08.734462 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3abdb03-232c-4fcb-a5d6-52e444a4d47d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:08.734915 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3abdb03-232c-4fcb-a5d6-52e444a4d47d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:08.861300 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c3abdb03-232c-4fcb-a5d6-52e444a4d47d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:08.869752 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c3abdb03-232c-4fcb-a5d6-52e444a4d47d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.148629 Jul 25 08:50:08.870321 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 294/555] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:08 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:09.599540 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-acf68bc6-e34c-4022-b4e8-fede3db57468 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:09.600160 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-acf68bc6-e34c-4022-b4e8-fede3db57468 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:09.606699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-acf68bc6-e34c-4022-b4e8-fede3db57468 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:09.607155 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-acf68bc6-e34c-4022-b4e8-fede3db57468 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:09.607919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-acf68bc6-e34c-4022-b4e8-fede3db57468 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:09.608361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-acf68bc6-e34c-4022-b4e8-fede3db57468 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:09.706331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d84eb585-a209-4dc2-aaef-442b0f7c2cce tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:09.706942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d84eb585-a209-4dc2-aaef-442b0f7c2cce tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:09.715154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d84eb585-a209-4dc2-aaef-442b0f7c2cce tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:09.715688 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d84eb585-a209-4dc2-aaef-442b0f7c2cce tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:09.716453 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d84eb585-a209-4dc2-aaef-442b0f7c2cce tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:09.716909 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d84eb585-a209-4dc2-aaef-442b0f7c2cce tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:09.740028 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-acf68bc6-e34c-4022-b4e8-fede3db57468 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:09.748098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-acf68bc6-e34c-4022-b4e8-fede3db57468 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.152358 Jul 25 08:50:09.748799 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 262/556] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:09 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:09.844595 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d84eb585-a209-4dc2-aaef-442b0f7c2cce tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:09.851935 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d84eb585-a209-4dc2-aaef-442b0f7c2cce tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.149946 Jul 25 08:50:09.852499 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 295/557] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:09 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:09.890562 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-59c09eff-7862-490f-b557-aef7482fcaa6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:09.891857 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-59c09eff-7862-490f-b557-aef7482fcaa6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:09.897902 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-59c09eff-7862-490f-b557-aef7482fcaa6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:09.898353 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-59c09eff-7862-490f-b557-aef7482fcaa6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:09.899116 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-59c09eff-7862-490f-b557-aef7482fcaa6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:09.899553 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-59c09eff-7862-490f-b557-aef7482fcaa6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:10.030657 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-59c09eff-7862-490f-b557-aef7482fcaa6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:10.037994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-59c09eff-7862-490f-b557-aef7482fcaa6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1359 microversion: 2.1 time: 0.151221 Jul 25 08:50:10.038553 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 263/558] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:09 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:10.441749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-74445109-e7f8-4fdf-be72-26b016498f2a req-29344723-cb43-4406-8589-43af964e23f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6", "name": "network-vif-plugged", "status": "completed", "tag": "f1ce2b2c-18a9-4cb3-9155-7b6d45a03700"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:10.451951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-74445109-e7f8-4fdf-be72-26b016498f2a req-29344723-cb43-4406-8589-43af964e23f3 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:10.452479 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-74445109-e7f8-4fdf-be72-26b016498f2a req-29344723-cb43-4406-8589-43af964e23f3 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:10.464216 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-74445109-e7f8-4fdf-be72-26b016498f2a req-29344723-cb43-4406-8589-43af964e23f3 service nova] Creating event network-vif-plugged:f1ce2b2c-18a9-4cb3-9155-7b6d45a03700 for instance e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 on hv-cinder-85084 Jul 25 08:50:10.469230 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-74445109-e7f8-4fdf-be72-26b016498f2a req-29344723-cb43-4406-8589-43af964e23f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031051 Jul 25 08:50:10.470429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 296/559] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:50:10.770350 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b304fba3-ed24-4c38-9ee5-ea562e96849d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:10.770964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b304fba3-ed24-4c38-9ee5-ea562e96849d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:10.777375 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b304fba3-ed24-4c38-9ee5-ea562e96849d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:10.777823 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b304fba3-ed24-4c38-9ee5-ea562e96849d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:10.778578 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b304fba3-ed24-4c38-9ee5-ea562e96849d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:10.779008 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b304fba3-ed24-4c38-9ee5-ea562e96849d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:10.873214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-30bff296-b956-40dd-a0ae-00d0d49dc65a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:10.873916 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-30bff296-b956-40dd-a0ae-00d0d49dc65a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:10.880775 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-30bff296-b956-40dd-a0ae-00d0d49dc65a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:10.881225 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-30bff296-b956-40dd-a0ae-00d0d49dc65a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:10.881980 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-30bff296-b956-40dd-a0ae-00d0d49dc65a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:10.882419 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-30bff296-b956-40dd-a0ae-00d0d49dc65a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:10.907560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b304fba3-ed24-4c38-9ee5-ea562e96849d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:10.915516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b304fba3-ed24-4c38-9ee5-ea562e96849d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.149544 Jul 25 08:50:10.916085 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 264/560] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:10 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:11.013110 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-30bff296-b956-40dd-a0ae-00d0d49dc65a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:11.020997 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-30bff296-b956-40dd-a0ae-00d0d49dc65a tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.152397 Jul 25 08:50:11.022638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 297/561] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:10 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:11.058263 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-adfe835c-381c-4df8-8fcd-0f88233a7a8d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:11.058875 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-adfe835c-381c-4df8-8fcd-0f88233a7a8d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:11.064800 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-adfe835c-381c-4df8-8fcd-0f88233a7a8d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:11.065248 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-adfe835c-381c-4df8-8fcd-0f88233a7a8d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:11.065993 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-adfe835c-381c-4df8-8fcd-0f88233a7a8d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:11.066419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-adfe835c-381c-4df8-8fcd-0f88233a7a8d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:11.195240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-adfe835c-381c-4df8-8fcd-0f88233a7a8d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:11.202969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-adfe835c-381c-4df8-8fcd-0f88233a7a8d tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1549 microversion: 2.1 time: 0.148353 Jul 25 08:50:11.203968 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 265/562] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:11 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:11.224249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-901b155a-91fe-4884-92e9-fa4a4299ef5b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:11.224880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-901b155a-91fe-4884-92e9-fa4a4299ef5b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:11.230729 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-901b155a-91fe-4884-92e9-fa4a4299ef5b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:11.231176 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-901b155a-91fe-4884-92e9-fa4a4299ef5b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:11.231920 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-901b155a-91fe-4884-92e9-fa4a4299ef5b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:11.232348 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-901b155a-91fe-4884-92e9-fa4a4299ef5b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:11.358401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-901b155a-91fe-4884-92e9-fa4a4299ef5b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:11.365801 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-901b155a-91fe-4884-92e9-fa4a4299ef5b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1549 microversion: 2.1 time: 0.145279 Jul 25 08:50:11.366361 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 298/563] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:11 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:11.386188 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-93a23a14-e307-4a29-8b6d-c0121fdbce90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:11.390863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-93a23a14-e307-4a29-8b6d-c0121fdbce90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:11.392201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-93a23a14-e307-4a29-8b6d-c0121fdbce90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Searching by: {'deleted': False, 'project_id': '3404b1a99987401183c8e3e851b382db'} {{(pid=124234) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 08:50:11.398727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-93a23a14-e307-4a29-8b6d-c0121fdbce90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:11.399170 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-93a23a14-e307-4a29-8b6d-c0121fdbce90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:11.399958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-93a23a14-e307-4a29-8b6d-c0121fdbce90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:11.400389 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-93a23a14-e307-4a29-8b6d-c0121fdbce90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:11.486979 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.multi_cell_list [None req-93a23a14-e307-4a29-8b6d-c0121fdbce90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124234) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 08:50:11.581321 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-93a23a14-e307-4a29-8b6d-c0121fdbce90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198843 Jul 25 08:50:11.581899 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 266/564] 10.222.0.52 () {58 vars in 1125 bytes} [Mon Jul 25 08:50:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:50:11.592793 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-37574e3f-638d-40c1-86ec-a128a8a89370 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:11.593395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-37574e3f-638d-40c1-86ec-a128a8a89370 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:11.599380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-37574e3f-638d-40c1-86ec-a128a8a89370 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:11.599821 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-37574e3f-638d-40c1-86ec-a128a8a89370 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:11.600590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-37574e3f-638d-40c1-86ec-a128a8a89370 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:11.601017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-37574e3f-638d-40c1-86ec-a128a8a89370 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:11.729005 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-37574e3f-638d-40c1-86ec-a128a8a89370 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:11.736832 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-37574e3f-638d-40c1-86ec-a128a8a89370 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1549 microversion: 2.1 time: 0.147751 Jul 25 08:50:11.737395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 299/565] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:11 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:11.940834 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-468474b3-a59c-4a14-8430-7b1c1cf84203 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:11.941459 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-468474b3-a59c-4a14-8430-7b1c1cf84203 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:11.948004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-468474b3-a59c-4a14-8430-7b1c1cf84203 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:11.948404 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-468474b3-a59c-4a14-8430-7b1c1cf84203 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:11.949195 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-468474b3-a59c-4a14-8430-7b1c1cf84203 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:11.949629 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-468474b3-a59c-4a14-8430-7b1c1cf84203 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:12.045532 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-11946f07-0039-433a-86ce-592c8c6d3ccb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:12.045532 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-11946f07-0039-433a-86ce-592c8c6d3ccb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:12.050004 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11946f07-0039-433a-86ce-592c8c6d3ccb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:12.050463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11946f07-0039-433a-86ce-592c8c6d3ccb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:12.051230 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11946f07-0039-433a-86ce-592c8c6d3ccb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:12.051667 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11946f07-0039-433a-86ce-592c8c6d3ccb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:12.134843 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-468474b3-a59c-4a14-8430-7b1c1cf84203 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:12.143738 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-468474b3-a59c-4a14-8430-7b1c1cf84203 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.207283 Jul 25 08:50:12.144315 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 267/566] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:11 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:12.199372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-11946f07-0039-433a-86ce-592c8c6d3ccb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:12.207382 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-11946f07-0039-433a-86ce-592c8c6d3ccb tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.168625 Jul 25 08:50:12.207943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 300/567] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:12 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:13.166226 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-37b01fe0-b81f-4ce4-96fb-a1b2b2cc8c60 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:13.166859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-37b01fe0-b81f-4ce4-96fb-a1b2b2cc8c60 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:13.169398 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=79 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:13.175844 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-37b01fe0-b81f-4ce4-96fb-a1b2b2cc8c60 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:13.176294 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-37b01fe0-b81f-4ce4-96fb-a1b2b2cc8c60 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:13.177103 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-37b01fe0-b81f-4ce4-96fb-a1b2b2cc8c60 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:13.177656 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-37b01fe0-b81f-4ce4-96fb-a1b2b2cc8c60 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:13.227059 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b207404c-9132-401c-8c41-2c473f1bba05 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:13.227670 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b207404c-9132-401c-8c41-2c473f1bba05 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:13.235206 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b207404c-9132-401c-8c41-2c473f1bba05 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:13.235863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b207404c-9132-401c-8c41-2c473f1bba05 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:13.236645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b207404c-9132-401c-8c41-2c473f1bba05 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:13.237237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b207404c-9132-401c-8c41-2c473f1bba05 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:13.256527 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:13.373550 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-37b01fe0-b81f-4ce4-96fb-a1b2b2cc8c60 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:13.383738 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-37b01fe0-b81f-4ce4-96fb-a1b2b2cc8c60 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.222010 Jul 25 08:50:13.385620 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 268/568] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:13 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:13.390697 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c8f1e60e-9b26-4a59-a5c8-ca7de27ccd90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2841bde6-c267-42c4-8321-4433aa81b28e"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:13.393540 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c8f1e60e-9b26-4a59-a5c8-ca7de27ccd90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:13.404177 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8f1e60e-9b26-4a59-a5c8-ca7de27ccd90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:13.404751 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8f1e60e-9b26-4a59-a5c8-ca7de27ccd90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:13.405606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8f1e60e-9b26-4a59-a5c8-ca7de27ccd90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:13.406116 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8f1e60e-9b26-4a59-a5c8-ca7de27ccd90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:13.407320 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b207404c-9132-401c-8c41-2c473f1bba05 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:13.426149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b207404c-9132-401c-8c41-2c473f1bba05 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1315 microversion: 2.1 time: 0.202741 Jul 25 08:50:13.426728 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 301/569] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:13 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:14.407748 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1b8fe8d9-9c4e-42ad-a627-af098875163d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:14.408390 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1b8fe8d9-9c4e-42ad-a627-af098875163d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:14.415046 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b8fe8d9-9c4e-42ad-a627-af098875163d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:14.415499 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b8fe8d9-9c4e-42ad-a627-af098875163d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:14.416268 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b8fe8d9-9c4e-42ad-a627-af098875163d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:14.416743 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b8fe8d9-9c4e-42ad-a627-af098875163d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:14.553585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1b8fe8d9-9c4e-42ad-a627-af098875163d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:14.561414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1b8fe8d9-9c4e-42ad-a627-af098875163d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.158069 Jul 25 08:50:14.561974 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 302/570] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:14 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:14.566279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ffdbe347-bbde-4ae9-a07e-98824f4941a6 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:14.566876 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ffdbe347-bbde-4ae9-a07e-98824f4941a6 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:14.572398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ffdbe347-bbde-4ae9-a07e-98824f4941a6 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:14.572873 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ffdbe347-bbde-4ae9-a07e-98824f4941a6 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:14.573631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ffdbe347-bbde-4ae9-a07e-98824f4941a6 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:14.574064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ffdbe347-bbde-4ae9-a07e-98824f4941a6 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:14.701764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ffdbe347-bbde-4ae9-a07e-98824f4941a6 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:14.709580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ffdbe347-bbde-4ae9-a07e-98824f4941a6 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1465 microversion: 2.1 time: 0.146688 Jul 25 08:50:14.710136 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 303/571] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:14 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1465 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:14.752904 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a54dd768-d62f-4074-b61c-e324e21e377b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:14.753395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a54dd768-d62f-4074-b61c-e324e21e377b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:14.759611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a54dd768-d62f-4074-b61c-e324e21e377b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:14.760058 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a54dd768-d62f-4074-b61c-e324e21e377b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:14.760844 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a54dd768-d62f-4074-b61c-e324e21e377b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:14.761277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a54dd768-d62f-4074-b61c-e324e21e377b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:14.788313 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a54dd768-d62f-4074-b61c-e324e21e377b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:50:14.860988 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a54dd768-d62f-4074-b61c-e324e21e377b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 204 len: 0 microversion: 2.1 time: 0.111533 Jul 25 08:50:14.861573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 304/572] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:50:14 2022] DELETE /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 08:50:14.869934 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c789c906-5cbf-4b7f-8145-50344d75faa2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:14.870754 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c789c906-5cbf-4b7f-8145-50344d75faa2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:14.877522 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c789c906-5cbf-4b7f-8145-50344d75faa2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:14.877956 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c789c906-5cbf-4b7f-8145-50344d75faa2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:14.878761 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c789c906-5cbf-4b7f-8145-50344d75faa2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:14.879137 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c789c906-5cbf-4b7f-8145-50344d75faa2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:15.014110 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c789c906-5cbf-4b7f-8145-50344d75faa2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:15.021989 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c789c906-5cbf-4b7f-8145-50344d75faa2 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1471 microversion: 2.1 time: 0.156067 Jul 25 08:50:15.022554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 305/573] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:14 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:15.582579 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f6c5f1f8-eab5-4c32-a8c7-1dd9305075e3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:15.583175 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f6c5f1f8-eab5-4c32-a8c7-1dd9305075e3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:15.589537 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6c5f1f8-eab5-4c32-a8c7-1dd9305075e3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:15.589981 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6c5f1f8-eab5-4c32-a8c7-1dd9305075e3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:15.590732 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6c5f1f8-eab5-4c32-a8c7-1dd9305075e3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:15.591157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6c5f1f8-eab5-4c32-a8c7-1dd9305075e3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:15.718108 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f6c5f1f8-eab5-4c32-a8c7-1dd9305075e3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:15.726101 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f6c5f1f8-eab5-4c32-a8c7-1dd9305075e3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.147804 Jul 25 08:50:15.726657 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 306/574] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:15 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:16.043151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ff862a10-e3b9-4673-8bc4-ba006cd78212 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:16.043764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ff862a10-e3b9-4673-8bc4-ba006cd78212 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:16.050463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff862a10-e3b9-4673-8bc4-ba006cd78212 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:16.050909 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff862a10-e3b9-4673-8bc4-ba006cd78212 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:16.051669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff862a10-e3b9-4673-8bc4-ba006cd78212 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:16.052101 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff862a10-e3b9-4673-8bc4-ba006cd78212 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:16.176893 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ff862a10-e3b9-4673-8bc4-ba006cd78212 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:16.184294 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ff862a10-e3b9-4673-8bc4-ba006cd78212 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1471 microversion: 2.1 time: 0.144930 Jul 25 08:50:16.184902 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 307/575] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:16 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:16.493425 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c8f1e60e-9b26-4a59-a5c8-ca7de27ccd90 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "POST /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.106320 Jul 25 08:50:16.494065 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 269/576] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:50:13 2022] POST /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments => generated 194 bytes in 3108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:50:16.747431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-db47fe44-a614-4dfe-8fda-93be00bbb03c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:16.748039 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-db47fe44-a614-4dfe-8fda-93be00bbb03c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:16.754734 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-db47fe44-a614-4dfe-8fda-93be00bbb03c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:16.755185 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-db47fe44-a614-4dfe-8fda-93be00bbb03c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:16.755950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-db47fe44-a614-4dfe-8fda-93be00bbb03c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:16.756888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-db47fe44-a614-4dfe-8fda-93be00bbb03c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:16.886017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-db47fe44-a614-4dfe-8fda-93be00bbb03c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:16.894091 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-db47fe44-a614-4dfe-8fda-93be00bbb03c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.150526 Jul 25 08:50:16.894656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 308/577] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:16 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:17.206518 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2ec01505-b0d0-4659-9319-b73a4467519b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:17.207211 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2ec01505-b0d0-4659-9319-b73a4467519b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:17.213540 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ec01505-b0d0-4659-9319-b73a4467519b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:17.213990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ec01505-b0d0-4659-9319-b73a4467519b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:17.214744 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ec01505-b0d0-4659-9319-b73a4467519b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:17.215175 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ec01505-b0d0-4659-9319-b73a4467519b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:17.343582 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2ec01505-b0d0-4659-9319-b73a4467519b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:17.351120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2ec01505-b0d0-4659-9319-b73a4467519b tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1471 microversion: 2.1 time: 0.149737 Jul 25 08:50:17.351705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 270/578] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:17 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:17.908906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-18db76d4-8dfd-46f4-b99f-182e6f8e2d2a req-8794de02-742d-4c0c-8cdd-5f7965fae196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6", "name": "network-vif-deleted", "tag": "f1ce2b2c-18a9-4cb3-9155-7b6d45a03700"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:17.915528 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0441bf97-d8a9-47d5-bd9e-9c5ab1b05b1d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:17.916861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0441bf97-d8a9-47d5-bd9e-9c5ab1b05b1d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:17.929966 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-18db76d4-8dfd-46f4-b99f-182e6f8e2d2a req-8794de02-742d-4c0c-8cdd-5f7965fae196 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:17.930466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-18db76d4-8dfd-46f4-b99f-182e6f8e2d2a req-8794de02-742d-4c0c-8cdd-5f7965fae196 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:17.930664 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0441bf97-d8a9-47d5-bd9e-9c5ab1b05b1d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:17.931122 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0441bf97-d8a9-47d5-bd9e-9c5ab1b05b1d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:17.931898 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0441bf97-d8a9-47d5-bd9e-9c5ab1b05b1d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:17.932333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0441bf97-d8a9-47d5-bd9e-9c5ab1b05b1d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:17.943357 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-18db76d4-8dfd-46f4-b99f-182e6f8e2d2a req-8794de02-742d-4c0c-8cdd-5f7965fae196 service nova] Creating event network-vif-deleted:f1ce2b2c-18a9-4cb3-9155-7b6d45a03700 for instance e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 on hv-cinder-85084 Jul 25 08:50:17.949141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-18db76d4-8dfd-46f4-b99f-182e6f8e2d2a req-8794de02-742d-4c0c-8cdd-5f7965fae196 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045608 Jul 25 08:50:17.950442 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 309/579] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:50:17.957178 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-84d05bcc-9944-49eb-9d9b-2659f65091a7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: .version_select at 0x7f0f79bd11f0>, body: {"keypair": {"name": "tempest-keypair-24328302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzRRNMCmnIN23KIAcVw8lgSWkAVVWaeSWwn+zuhKkKXQaSUAlA21s4/dFy6p6yHac7pgx7dc78aBIFUmU7AvCf52TBw4UiiwaLKeGBUoljpgIwDixhbE0eE8SRCWV1F3g=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:17.972868 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-84d05bcc-9944-49eb-9d9b-2659f65091a7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:50:17.976971 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-84d05bcc-9944-49eb-9d9b-2659f65091a7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for user 8e682232b7374450a7265e092602a5a6 and project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:50:18.005751 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-84d05bcc-9944-49eb-9d9b-2659f65091a7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.053529 Jul 25 08:50:18.006423 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 310/580] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Jul 25 08:50:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:50:18.117433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0441bf97-d8a9-47d5-bd9e-9c5ab1b05b1d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:18.130483 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0441bf97-d8a9-47d5-bd9e-9c5ab1b05b1d tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.218820 Jul 25 08:50:18.131771 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 271/581] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:17 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:18.371332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:18.372068 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:18.378270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:18.378718 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:18.379750 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:18.380186 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:18.411573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:18.412020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:18.412465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lazy-loading 'fault' on Instance uuid e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:50:18.457913 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a6dd88b54d47bb83bedb2ef86b728b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1e7e45df467f816bc14d6f861934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:18.465670 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b873d901-a819-4d66-93ad-e051fef4da3d tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 200 len: 1305 microversion: 2.1 time: 0.098231 Jul 25 08:50:18.466237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 311/582] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:18 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:19.151646 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a5b72481-d41a-466e-a98b-1feb8bd7a858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:19.152536 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a5b72481-d41a-466e-a98b-1feb8bd7a858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:19.159303 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5b72481-d41a-466e-a98b-1feb8bd7a858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:19.160272 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5b72481-d41a-466e-a98b-1feb8bd7a858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:19.161163 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5b72481-d41a-466e-a98b-1feb8bd7a858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:19.161595 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5b72481-d41a-466e-a98b-1feb8bd7a858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:19.298910 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a5b72481-d41a-466e-a98b-1feb8bd7a858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:19.307240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a5b72481-d41a-466e-a98b-1feb8bd7a858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.158938 Jul 25 08:50:19.307355 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 272/583] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:19 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:19.336134 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-469216157", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ca11239-7898-4751-a9c6-3b03bbecba12"}], "security_groups": [{"name": "tempest-securitygroup--386998440"}], "key_name": "tempest-keypair-24328302", "user_data": "}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:19.438565 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] validate_networks() for [('6ca11239-7898-4751-a9c6-3b03bbecba12', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:50:19.487261 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-859593c5-7375-4922-9403-2069f4358224 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:19.487892 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-859593c5-7375-4922-9403-2069f4358224 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] [instance: e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:19.493713 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-859593c5-7375-4922-9403-2069f4358224 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:19.494159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-859593c5-7375-4922-9403-2069f4358224 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:19.494909 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-859593c5-7375-4922-9403-2069f4358224 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:19.495334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-859593c5-7375-4922-9403-2069f4358224 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:19.508681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-859593c5-7375-4922-9403-2069f4358224 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] HTTP exception thrown: Instance e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 could not be found. Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-859593c5-7375-4922-9403-2069f4358224 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Request method failure captured: Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 HTTP/1.1 Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lj_m67xWbP18F0g4sNY2Xsn86GgUYzxu0qKe3gH9ju0BXR6R6TLDmrOO6VciEaCPAACSL-aZlWdknM7sM32ijH4KzZlBMfAP_pY4j9fyFwkoQlFrz-PXn_sraPe918Q1Q8t8iAPniSYyLXocTdyqWz-xKNeV2bXQsMPvNVd3ojwF3s Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: d63f1e7e45df467f816bc14d6f861934 Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-VolumesNegativeTest-591937892 Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:50:19.510340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d63f1e7e45df467f816bc14d6f861934"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d63f1e7e45df467f816bc14d6f861934", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d63f1e7e45df467f816bc14d6f861934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d63f1e7e45df467f816bc14d6f861934"}]}] Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-VolumesNegativeTest-591937892 Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: d63f1e7e45df467f816bc14d6f861934 Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-VolumesNegativeTest-591937892 Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-VolumesNegativeTest-591937892-project Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 28a6dd88b54d47bb83bedb2ef86b728b Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-VolumesNegativeTest-591937892-project Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 could not be found. Jul 25 08:50:19.511977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6'} Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 could not be found. Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:50:19.513680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 could not be found. Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 could not be found. Jul 25 08:50:19.515147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:50:19.517039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-859593c5-7375-4922-9403-2069f4358224 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] Returning 404 to user: Instance e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:50:19.517039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-859593c5-7375-4922-9403-2069f4358224 tempest-VolumesNegativeTest-591937892 tempest-VolumesNegativeTest-591937892-project] 10.222.0.52 "GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6" status: 404 len: 111 microversion: 2.1 time: 0.028306 Jul 25 08:50:19.517039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 273/584] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:19 2022] GET /compute/v2.1/servers/e05e77f0-925e-4fcc-a23e-0cc0d4d1f2e6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 08:50:19.829063 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:50:19.829509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:50:19.829972 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:50:19.830374 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:50:19.830772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:50:19.840651 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:19.841092 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:19.841875 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:19.842303 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:19.858471 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:50:19.862758 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for user 8e682232b7374450a7265e092602a5a6 and project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:50:19.873814 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:50:19.876743 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:50:19.924363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4f492635-d1f2-44b0-b001-7b8d515ac620 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.592506 Jul 25 08:50:19.925211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 312/585] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:50:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:50:19.937026 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a9a02588-4bc8-4c62-ae92-0e9ffeaebda8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:19.938563 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a9a02588-4bc8-4c62-ae92-0e9ffeaebda8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:20.010676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a9a02588-4bc8-4c62-ae92-0e9ffeaebda8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:20.019172 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a9a02588-4bc8-4c62-ae92-0e9ffeaebda8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1239 microversion: 2.1 time: 0.086985 Jul 25 08:50:20.020563 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 274/586] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:19 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:20.329891 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c09fe8df-b8a3-4890-bf6c-055e36dbff9b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:20.330662 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c09fe8df-b8a3-4890-bf6c-055e36dbff9b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:20.338904 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c09fe8df-b8a3-4890-bf6c-055e36dbff9b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:20.340055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c09fe8df-b8a3-4890-bf6c-055e36dbff9b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:20.341386 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c09fe8df-b8a3-4890-bf6c-055e36dbff9b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:20.341918 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c09fe8df-b8a3-4890-bf6c-055e36dbff9b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:20.501760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c09fe8df-b8a3-4890-bf6c-055e36dbff9b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:20.510110 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c09fe8df-b8a3-4890-bf6c-055e36dbff9b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.185254 Jul 25 08:50:20.511021 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 313/587] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:20 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:21.044396 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c3bf5690-3e7d-4309-b8fe-ffc7ffcba9af tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:21.048001 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c3bf5690-3e7d-4309-b8fe-ffc7ffcba9af tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:21.055259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c3bf5690-3e7d-4309-b8fe-ffc7ffcba9af tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:21.055717 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c3bf5690-3e7d-4309-b8fe-ffc7ffcba9af tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:21.058430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c3bf5690-3e7d-4309-b8fe-ffc7ffcba9af tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:21.058430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c3bf5690-3e7d-4309-b8fe-ffc7ffcba9af tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:21.146290 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c3bf5690-3e7d-4309-b8fe-ffc7ffcba9af tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:21.160404 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c3bf5690-3e7d-4309-b8fe-ffc7ffcba9af tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1299 microversion: 2.1 time: 0.119572 Jul 25 08:50:21.161584 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 275/588] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:21 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:21.533545 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9bc944a6-fcb3-43fa-8c70-c8f929bd5239 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:21.534193 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9bc944a6-fcb3-43fa-8c70-c8f929bd5239 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:21.542954 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9bc944a6-fcb3-43fa-8c70-c8f929bd5239 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:21.543587 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9bc944a6-fcb3-43fa-8c70-c8f929bd5239 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:21.544781 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9bc944a6-fcb3-43fa-8c70-c8f929bd5239 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:21.545218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9bc944a6-fcb3-43fa-8c70-c8f929bd5239 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:21.694336 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9bc944a6-fcb3-43fa-8c70-c8f929bd5239 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:21.704401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9bc944a6-fcb3-43fa-8c70-c8f929bd5239 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.176170 Jul 25 08:50:21.706060 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 314/589] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:21 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:22.182932 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b2cd5792-59cd-4a1b-bf2d-4d5f2aa52e32 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:22.183548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b2cd5792-59cd-4a1b-bf2d-4d5f2aa52e32 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:22.185527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:22.192729 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b2cd5792-59cd-4a1b-bf2d-4d5f2aa52e32 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:22.193217 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b2cd5792-59cd-4a1b-bf2d-4d5f2aa52e32 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:22.193993 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b2cd5792-59cd-4a1b-bf2d-4d5f2aa52e32 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:22.194427 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b2cd5792-59cd-4a1b-bf2d-4d5f2aa52e32 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:22.380526 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b2cd5792-59cd-4a1b-bf2d-4d5f2aa52e32 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:22.388716 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b2cd5792-59cd-4a1b-bf2d-4d5f2aa52e32 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.209828 Jul 25 08:50:22.389289 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 276/590] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:22 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:22.726298 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6bf9888c-b18a-4774-9154-5c468049bce4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:22.726967 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6bf9888c-b18a-4774-9154-5c468049bce4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:22.733750 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6bf9888c-b18a-4774-9154-5c468049bce4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:22.734249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6bf9888c-b18a-4774-9154-5c468049bce4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:22.735212 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6bf9888c-b18a-4774-9154-5c468049bce4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:22.735656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6bf9888c-b18a-4774-9154-5c468049bce4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:22.792975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-eda69617-0c1f-4903-9fe3-218be680131a req-f0985812-799c-4249-9bfa-68265666cf78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5263978-0aac-41bf-adad-05221bb69a08", "tag": "702582ed-3157-4dee-b38e-d158d8ec1b75"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:22.815960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-eda69617-0c1f-4903-9fe3-218be680131a req-f0985812-799c-4249-9bfa-68265666cf78 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:22.816413 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-eda69617-0c1f-4903-9fe3-218be680131a req-f0985812-799c-4249-9bfa-68265666cf78 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:22.828124 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-eda69617-0c1f-4903-9fe3-218be680131a req-f0985812-799c-4249-9bfa-68265666cf78 service nova] Creating event network-changed:702582ed-3157-4dee-b38e-d158d8ec1b75 for instance d5263978-0aac-41bf-adad-05221bb69a08 on hv-cinder-85084 Jul 25 08:50:22.833204 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-eda69617-0c1f-4903-9fe3-218be680131a req-f0985812-799c-4249-9bfa-68265666cf78 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052570 Jul 25 08:50:22.834360 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 277/591] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:50:22.899019 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6bf9888c-b18a-4774-9154-5c468049bce4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:22.908897 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6bf9888c-b18a-4774-9154-5c468049bce4 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.185669 Jul 25 08:50:22.909896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 315/592] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:22 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:23.410930 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-06c07f2b-f3fa-4eb1-8742-3a733139321b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:23.411628 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-06c07f2b-f3fa-4eb1-8742-3a733139321b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:23.417795 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-06c07f2b-f3fa-4eb1-8742-3a733139321b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:23.418251 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-06c07f2b-f3fa-4eb1-8742-3a733139321b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:23.419008 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-06c07f2b-f3fa-4eb1-8742-3a733139321b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:23.419443 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-06c07f2b-f3fa-4eb1-8742-3a733139321b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:23.550097 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-06c07f2b-f3fa-4eb1-8742-3a733139321b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:23.553717 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:23.558843 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-06c07f2b-f3fa-4eb1-8742-3a733139321b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.152718 Jul 25 08:50:23.559412 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 278/593] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:23 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:23.930949 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ad7610bd-3dd7-4907-af3e-6de2b9946998 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:23.931779 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ad7610bd-3dd7-4907-af3e-6de2b9946998 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:23.938062 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad7610bd-3dd7-4907-af3e-6de2b9946998 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:23.938507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad7610bd-3dd7-4907-af3e-6de2b9946998 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:23.939265 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad7610bd-3dd7-4907-af3e-6de2b9946998 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:23.939689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad7610bd-3dd7-4907-af3e-6de2b9946998 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:24.084834 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ad7610bd-3dd7-4907-af3e-6de2b9946998 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:24.093012 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ad7610bd-3dd7-4907-af3e-6de2b9946998 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.165780 Jul 25 08:50:24.093864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 316/594] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:23 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:24.579250 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3d596773-db0f-46ab-ab01-3e4fabe93fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:24.579876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3d596773-db0f-46ab-ab01-3e4fabe93fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:24.587591 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3d596773-db0f-46ab-ab01-3e4fabe93fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:24.588043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3d596773-db0f-46ab-ab01-3e4fabe93fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:24.588847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3d596773-db0f-46ab-ab01-3e4fabe93fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:24.589285 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3d596773-db0f-46ab-ab01-3e4fabe93fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:24.715268 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3d596773-db0f-46ab-ab01-3e4fabe93fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:24.723066 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3d596773-db0f-46ab-ab01-3e4fabe93fef tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.147670 Jul 25 08:50:24.723623 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 279/595] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:24 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:25.113777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-918e9795-062b-4700-a743-7c1490b0972e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:25.114424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-918e9795-062b-4700-a743-7c1490b0972e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:25.121025 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-918e9795-062b-4700-a743-7c1490b0972e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:25.121551 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-918e9795-062b-4700-a743-7c1490b0972e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:25.122351 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-918e9795-062b-4700-a743-7c1490b0972e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:25.122825 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-918e9795-062b-4700-a743-7c1490b0972e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:25.251352 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-918e9795-062b-4700-a743-7c1490b0972e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:25.259443 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-918e9795-062b-4700-a743-7c1490b0972e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.149481 Jul 25 08:50:25.260017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 317/596] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:25 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:25.743608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-02d46d80-4601-40b4-9e8a-b6d198723b2d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:25.744224 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-02d46d80-4601-40b4-9e8a-b6d198723b2d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:25.751429 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-02d46d80-4601-40b4-9e8a-b6d198723b2d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:25.751879 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-02d46d80-4601-40b4-9e8a-b6d198723b2d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:25.752661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-02d46d80-4601-40b4-9e8a-b6d198723b2d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:25.753096 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-02d46d80-4601-40b4-9e8a-b6d198723b2d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:25.880738 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-02d46d80-4601-40b4-9e8a-b6d198723b2d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:25.887965 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-02d46d80-4601-40b4-9e8a-b6d198723b2d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.148216 Jul 25 08:50:25.888531 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 280/597] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:25 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:26.280730 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-34feae36-40d0-4034-a8a4-4465a4bd50e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:26.281986 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-34feae36-40d0-4034-a8a4-4465a4bd50e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:26.288455 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34feae36-40d0-4034-a8a4-4465a4bd50e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:26.288942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34feae36-40d0-4034-a8a4-4465a4bd50e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:26.289749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34feae36-40d0-4034-a8a4-4465a4bd50e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:26.290188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34feae36-40d0-4034-a8a4-4465a4bd50e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:26.308179 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:26.429720 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-34feae36-40d0-4034-a8a4-4465a4bd50e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:26.438362 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-34feae36-40d0-4034-a8a4-4465a4bd50e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1726 microversion: 2.1 time: 0.161463 Jul 25 08:50:26.438910 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 318/598] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:26 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:26.908979 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-788b776b-8404-4ace-a1f0-351811ea5985 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:26.909588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-788b776b-8404-4ace-a1f0-351811ea5985 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:26.916129 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-788b776b-8404-4ace-a1f0-351811ea5985 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:26.916606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-788b776b-8404-4ace-a1f0-351811ea5985 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:26.917349 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-788b776b-8404-4ace-a1f0-351811ea5985 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:26.917781 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-788b776b-8404-4ace-a1f0-351811ea5985 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:27.043782 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-788b776b-8404-4ace-a1f0-351811ea5985 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:27.051117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-788b776b-8404-4ace-a1f0-351811ea5985 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.145926 Jul 25 08:50:27.051670 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 281/599] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:26 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:27.458955 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ebfc2974-e36a-4e18-838c-f563e0662a89 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:27.459484 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ebfc2974-e36a-4e18-838c-f563e0662a89 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:27.465961 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ebfc2974-e36a-4e18-838c-f563e0662a89 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:27.466407 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ebfc2974-e36a-4e18-838c-f563e0662a89 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:27.467162 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ebfc2974-e36a-4e18-838c-f563e0662a89 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:27.467591 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ebfc2974-e36a-4e18-838c-f563e0662a89 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:27.592344 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ebfc2974-e36a-4e18-838c-f563e0662a89 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:27.600945 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ebfc2974-e36a-4e18-838c-f563e0662a89 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1703 microversion: 2.1 time: 0.145811 Jul 25 08:50:27.601679 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 319/600] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:27 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1703 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:27.622437 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-309201de-b7fe-48ab-ada3-c73d1d3bca42 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:27.629860 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-309201de-b7fe-48ab-ada3-c73d1d3bca42 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:27.630396 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-309201de-b7fe-48ab-ada3-c73d1d3bca42 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:27.653237 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-309201de-b7fe-48ab-ada3-c73d1d3bca42 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Going to try to start instance {{(pid=124234) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 08:50:27.697531 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-309201de-b7fe-48ab-ada3-c73d1d3bca42 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/action" status: 202 len: 0 microversion: 2.1 time: 0.078731 Jul 25 08:50:27.698471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 282/601] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:50:27 2022] POST /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 08:50:27.708476 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-387b058d-45ee-4bfa-98e9-6e8613d8faa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:27.709619 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-387b058d-45ee-4bfa-98e9-6e8613d8faa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:27.716432 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-387b058d-45ee-4bfa-98e9-6e8613d8faa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:27.717138 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-387b058d-45ee-4bfa-98e9-6e8613d8faa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:27.718330 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-387b058d-45ee-4bfa-98e9-6e8613d8faa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:27.719047 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-387b058d-45ee-4bfa-98e9-6e8613d8faa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:27.855268 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-387b058d-45ee-4bfa-98e9-6e8613d8faa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:27.864540 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-387b058d-45ee-4bfa-98e9-6e8613d8faa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1712 microversion: 2.1 time: 0.161672 Jul 25 08:50:27.865848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 320/602] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:27 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1712 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:50:28.071677 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-95c0edef-1f56-4e38-acdc-8c9b0c57a2f8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:28.072397 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-95c0edef-1f56-4e38-acdc-8c9b0c57a2f8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:28.079395 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-95c0edef-1f56-4e38-acdc-8c9b0c57a2f8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:28.079843 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-95c0edef-1f56-4e38-acdc-8c9b0c57a2f8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:28.080638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-95c0edef-1f56-4e38-acdc-8c9b0c57a2f8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:28.081069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-95c0edef-1f56-4e38-acdc-8c9b0c57a2f8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:28.247022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-95c0edef-1f56-4e38-acdc-8c9b0c57a2f8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:28.256110 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-95c0edef-1f56-4e38-acdc-8c9b0c57a2f8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.188478 Jul 25 08:50:28.268615 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 283/603] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:28 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:28.886787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0377e94c-2b5b-45e7-ac89-f26575b4c46b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:28.887441 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0377e94c-2b5b-45e7-ac89-f26575b4c46b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:28.894211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0377e94c-2b5b-45e7-ac89-f26575b4c46b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:28.894662 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0377e94c-2b5b-45e7-ac89-f26575b4c46b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:28.895493 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0377e94c-2b5b-45e7-ac89-f26575b4c46b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:28.895929 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0377e94c-2b5b-45e7-ac89-f26575b4c46b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:29.026002 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0377e94c-2b5b-45e7-ac89-f26575b4c46b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:29.033895 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0377e94c-2b5b-45e7-ac89-f26575b4c46b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1712 microversion: 2.1 time: 0.151128 Jul 25 08:50:29.034459 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 321/604] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:28 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1712 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:29.285757 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2ed2741f-11ae-45dc-93d6-d66505be6bcd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:29.286345 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2ed2741f-11ae-45dc-93d6-d66505be6bcd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:29.292970 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ed2741f-11ae-45dc-93d6-d66505be6bcd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:29.293419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ed2741f-11ae-45dc-93d6-d66505be6bcd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:29.294188 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ed2741f-11ae-45dc-93d6-d66505be6bcd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:29.294607 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ed2741f-11ae-45dc-93d6-d66505be6bcd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:29.421291 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2ed2741f-11ae-45dc-93d6-d66505be6bcd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:29.429300 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2ed2741f-11ae-45dc-93d6-d66505be6bcd tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.147284 Jul 25 08:50:29.429845 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 284/605] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:29 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:30.054861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6850fbf7-0d14-4efe-9802-00339c02eec7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:30.055472 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6850fbf7-0d14-4efe-9802-00339c02eec7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:30.057387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:30.058040 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=10 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:30.064944 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6850fbf7-0d14-4efe-9802-00339c02eec7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:30.065399 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6850fbf7-0d14-4efe-9802-00339c02eec7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:30.066170 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6850fbf7-0d14-4efe-9802-00339c02eec7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:30.066608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6850fbf7-0d14-4efe-9802-00339c02eec7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:30.194972 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6850fbf7-0d14-4efe-9802-00339c02eec7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:30.203315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6850fbf7-0d14-4efe-9802-00339c02eec7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1712 microversion: 2.1 time: 0.152258 Jul 25 08:50:30.203891 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 322/606] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:30 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1712 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:30.450328 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9c2f7aac-af2c-40b6-ad13-e9584a67d87a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:30.450943 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9c2f7aac-af2c-40b6-ad13-e9584a67d87a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:30.453430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:30.459363 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c2f7aac-af2c-40b6-ad13-e9584a67d87a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:30.459809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c2f7aac-af2c-40b6-ad13-e9584a67d87a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:30.460565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c2f7aac-af2c-40b6-ad13-e9584a67d87a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:30.461029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c2f7aac-af2c-40b6-ad13-e9584a67d87a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:30.591218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9c2f7aac-af2c-40b6-ad13-e9584a67d87a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:30.600066 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9c2f7aac-af2c-40b6-ad13-e9584a67d87a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.153560 Jul 25 08:50:30.600664 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 285/607] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:30 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:31.223418 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-87cf5b3d-2845-4b92-9787-c3531c4a9837 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:31.223959 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-87cf5b3d-2845-4b92-9787-c3531c4a9837 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:31.230612 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87cf5b3d-2845-4b92-9787-c3531c4a9837 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:31.231056 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87cf5b3d-2845-4b92-9787-c3531c4a9837 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:31.231837 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87cf5b3d-2845-4b92-9787-c3531c4a9837 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:31.232267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87cf5b3d-2845-4b92-9787-c3531c4a9837 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:31.359785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-87cf5b3d-2845-4b92-9787-c3531c4a9837 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:31.367661 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-87cf5b3d-2845-4b92-9787-c3531c4a9837 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1712 microversion: 2.1 time: 0.148226 Jul 25 08:50:31.368233 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 323/608] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:31 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:31.621153 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9334c2c6-902f-4f48-85df-205d2abe1c01 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:31.621733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9334c2c6-902f-4f48-85df-205d2abe1c01 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:31.628754 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9334c2c6-902f-4f48-85df-205d2abe1c01 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:31.629461 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9334c2c6-902f-4f48-85df-205d2abe1c01 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:31.630213 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9334c2c6-902f-4f48-85df-205d2abe1c01 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:31.630641 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9334c2c6-902f-4f48-85df-205d2abe1c01 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:31.758422 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9334c2c6-902f-4f48-85df-205d2abe1c01 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:31.766203 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9334c2c6-902f-4f48-85df-205d2abe1c01 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.148776 Jul 25 08:50:31.766760 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 286/609] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:31 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:32.389495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3cbf6b87-9fad-449c-a2e6-08c27f117ec8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:32.390146 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3cbf6b87-9fad-449c-a2e6-08c27f117ec8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:32.396854 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cbf6b87-9fad-449c-a2e6-08c27f117ec8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:32.397313 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cbf6b87-9fad-449c-a2e6-08c27f117ec8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:32.398075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cbf6b87-9fad-449c-a2e6-08c27f117ec8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:32.398510 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cbf6b87-9fad-449c-a2e6-08c27f117ec8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:32.525717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3cbf6b87-9fad-449c-a2e6-08c27f117ec8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:32.534119 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3cbf6b87-9fad-449c-a2e6-08c27f117ec8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1712 microversion: 2.1 time: 0.148463 Jul 25 08:50:32.534678 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 324/610] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:32 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1712 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:32.787097 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-cfebb2a5-ab8c-4cc5-b33c-16f7a9b16740 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:32.787709 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-cfebb2a5-ab8c-4cc5-b33c-16f7a9b16740 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:32.794240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cfebb2a5-ab8c-4cc5-b33c-16f7a9b16740 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:32.794685 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cfebb2a5-ab8c-4cc5-b33c-16f7a9b16740 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:32.795432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cfebb2a5-ab8c-4cc5-b33c-16f7a9b16740 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:32.795859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cfebb2a5-ab8c-4cc5-b33c-16f7a9b16740 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:32.924070 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-cfebb2a5-ab8c-4cc5-b33c-16f7a9b16740 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:32.931442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-cfebb2a5-ab8c-4cc5-b33c-16f7a9b16740 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.148118 Jul 25 08:50:32.932005 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 287/611] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:32 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:33.555121 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d3c4d83a-605a-4501-87bd-dd7b7afdcae3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:33.555728 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d3c4d83a-605a-4501-87bd-dd7b7afdcae3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:33.562895 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3c4d83a-605a-4501-87bd-dd7b7afdcae3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:33.563284 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3c4d83a-605a-4501-87bd-dd7b7afdcae3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:33.564042 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3c4d83a-605a-4501-87bd-dd7b7afdcae3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:33.564474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3c4d83a-605a-4501-87bd-dd7b7afdcae3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:33.696924 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d3c4d83a-605a-4501-87bd-dd7b7afdcae3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:33.703598 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d3c4d83a-605a-4501-87bd-dd7b7afdcae3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1712 microversion: 2.1 time: 0.152226 Jul 25 08:50:33.709468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 325/612] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:33 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:33.951273 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bced41dd-ce67-4e2e-8b8f-729fa6378ace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:33.951883 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bced41dd-ce67-4e2e-8b8f-729fa6378ace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:33.958371 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bced41dd-ce67-4e2e-8b8f-729fa6378ace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:33.958816 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bced41dd-ce67-4e2e-8b8f-729fa6378ace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:33.959628 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bced41dd-ce67-4e2e-8b8f-729fa6378ace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:33.960062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bced41dd-ce67-4e2e-8b8f-729fa6378ace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:34.087500 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bced41dd-ce67-4e2e-8b8f-729fa6378ace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:34.095351 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bced41dd-ce67-4e2e-8b8f-729fa6378ace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.147949 Jul 25 08:50:34.095950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 288/613] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:33 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:34.724158 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ce485519-8b4e-4b28-b9d5-a98794a90eb0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:34.724797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ce485519-8b4e-4b28-b9d5-a98794a90eb0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:34.731261 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ce485519-8b4e-4b28-b9d5-a98794a90eb0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:34.731714 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ce485519-8b4e-4b28-b9d5-a98794a90eb0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:34.732472 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ce485519-8b4e-4b28-b9d5-a98794a90eb0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:34.732942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ce485519-8b4e-4b28-b9d5-a98794a90eb0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:34.863024 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ce485519-8b4e-4b28-b9d5-a98794a90eb0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:34.871335 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ce485519-8b4e-4b28-b9d5-a98794a90eb0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1716 microversion: 2.1 time: 0.151019 Jul 25 08:50:34.872059 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 326/614] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:34 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:35.116035 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-42f36d9f-600f-4b5b-9d21-eff391bfa84d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:35.116607 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-42f36d9f-600f-4b5b-9d21-eff391bfa84d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:35.123282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-42f36d9f-600f-4b5b-9d21-eff391bfa84d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:35.123773 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-42f36d9f-600f-4b5b-9d21-eff391bfa84d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:35.124680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-42f36d9f-600f-4b5b-9d21-eff391bfa84d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:35.125192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-42f36d9f-600f-4b5b-9d21-eff391bfa84d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:35.249565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-42f36d9f-600f-4b5b-9d21-eff391bfa84d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:35.257207 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-42f36d9f-600f-4b5b-9d21-eff391bfa84d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.145056 Jul 25 08:50:35.257769 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 289/615] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:35 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:36.278284 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-af2d4e0b-892e-43cc-bfd5-a4c59d08e025 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:36.278839 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-af2d4e0b-892e-43cc-bfd5-a4c59d08e025 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:36.281251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:36.286737 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af2d4e0b-892e-43cc-bfd5-a4c59d08e025 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:36.287182 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af2d4e0b-892e-43cc-bfd5-a4c59d08e025 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:36.287938 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af2d4e0b-892e-43cc-bfd5-a4c59d08e025 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:36.288367 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af2d4e0b-892e-43cc-bfd5-a4c59d08e025 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:36.417429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-af2d4e0b-892e-43cc-bfd5-a4c59d08e025 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:36.425238 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-af2d4e0b-892e-43cc-bfd5-a4c59d08e025 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.150868 Jul 25 08:50:36.425795 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 327/616] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:36 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:37.447077 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9dad34dd-4477-4f14-a079-e0e504bd5831 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:37.447691 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9dad34dd-4477-4f14-a079-e0e504bd5831 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:37.454851 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9dad34dd-4477-4f14-a079-e0e504bd5831 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:37.455302 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9dad34dd-4477-4f14-a079-e0e504bd5831 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:37.456062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9dad34dd-4477-4f14-a079-e0e504bd5831 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:37.456498 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9dad34dd-4477-4f14-a079-e0e504bd5831 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:37.582637 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9dad34dd-4477-4f14-a079-e0e504bd5831 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:37.590100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9dad34dd-4477-4f14-a079-e0e504bd5831 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.146848 Jul 25 08:50:37.590684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 290/617] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:37 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:38.611046 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dbcb9639-0d42-40a8-b9fc-d4beb0c045b7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:38.611610 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dbcb9639-0d42-40a8-b9fc-d4beb0c045b7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:38.618167 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dbcb9639-0d42-40a8-b9fc-d4beb0c045b7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:38.618620 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dbcb9639-0d42-40a8-b9fc-d4beb0c045b7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:38.619385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dbcb9639-0d42-40a8-b9fc-d4beb0c045b7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:38.619821 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dbcb9639-0d42-40a8-b9fc-d4beb0c045b7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:38.744222 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dbcb9639-0d42-40a8-b9fc-d4beb0c045b7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:38.752374 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dbcb9639-0d42-40a8-b9fc-d4beb0c045b7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.145797 Jul 25 08:50:38.753166 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 328/618] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:38 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:39.774653 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ad89a482-82ca-44d0-98a0-3c7c3f0e38a8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:39.775268 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ad89a482-82ca-44d0-98a0-3c7c3f0e38a8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:39.782504 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad89a482-82ca-44d0-98a0-3c7c3f0e38a8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:39.782984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad89a482-82ca-44d0-98a0-3c7c3f0e38a8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:39.783761 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad89a482-82ca-44d0-98a0-3c7c3f0e38a8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:39.784332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad89a482-82ca-44d0-98a0-3c7c3f0e38a8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:39.784448 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-60aef872-6ad2-48dc-9422-bcbf60963122 req-8a09c336-800e-4d77-97e3-5ffbbd7d0ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5263978-0aac-41bf-adad-05221bb69a08", "name": "network-vif-plugged", "status": "completed", "tag": "702582ed-3157-4dee-b38e-d158d8ec1b75"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:39.796812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-60aef872-6ad2-48dc-9422-bcbf60963122 req-8a09c336-800e-4d77-97e3-5ffbbd7d0ae6 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:39.798748 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-60aef872-6ad2-48dc-9422-bcbf60963122 req-8a09c336-800e-4d77-97e3-5ffbbd7d0ae6 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:39.815653 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-60aef872-6ad2-48dc-9422-bcbf60963122 req-8a09c336-800e-4d77-97e3-5ffbbd7d0ae6 service nova] Creating event network-vif-plugged:702582ed-3157-4dee-b38e-d158d8ec1b75 for instance d5263978-0aac-41bf-adad-05221bb69a08 on hv-cinder-85084 Jul 25 08:50:39.822573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-60aef872-6ad2-48dc-9422-bcbf60963122 req-8a09c336-800e-4d77-97e3-5ffbbd7d0ae6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042801 Jul 25 08:50:39.824812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 329/619] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:50:39.923582 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ad89a482-82ca-44d0-98a0-3c7c3f0e38a8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:39.931000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ad89a482-82ca-44d0-98a0-3c7c3f0e38a8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.161000 Jul 25 08:50:39.931747 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 291/620] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:39 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:40.951789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-30abfe95-a740-4c4b-acc6-d1b0605d3bbb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:40.953024 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-30abfe95-a740-4c4b-acc6-d1b0605d3bbb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:40.959694 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-30abfe95-a740-4c4b-acc6-d1b0605d3bbb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:40.960138 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-30abfe95-a740-4c4b-acc6-d1b0605d3bbb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:40.960916 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-30abfe95-a740-4c4b-acc6-d1b0605d3bbb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:40.961342 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-30abfe95-a740-4c4b-acc6-d1b0605d3bbb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:41.088219 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-30abfe95-a740-4c4b-acc6-d1b0605d3bbb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:41.096189 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-30abfe95-a740-4c4b-acc6-d1b0605d3bbb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.148580 Jul 25 08:50:41.096773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 330/621] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:40 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:42.115927 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9d6c4223-c47e-41f7-b9c0-e92a657782da tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:42.116537 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9d6c4223-c47e-41f7-b9c0-e92a657782da tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:42.123064 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9d6c4223-c47e-41f7-b9c0-e92a657782da tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:42.123508 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9d6c4223-c47e-41f7-b9c0-e92a657782da tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:42.124787 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9d6c4223-c47e-41f7-b9c0-e92a657782da tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:42.125213 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9d6c4223-c47e-41f7-b9c0-e92a657782da tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:42.253407 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9d6c4223-c47e-41f7-b9c0-e92a657782da tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:42.260951 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9d6c4223-c47e-41f7-b9c0-e92a657782da tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.148790 Jul 25 08:50:42.261502 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 292/622] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:42 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:43.283036 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c1f954a3-8b80-462f-98ab-24c07c7d2fec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:43.283644 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c1f954a3-8b80-462f-98ab-24c07c7d2fec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:43.290174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1f954a3-8b80-462f-98ab-24c07c7d2fec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:43.290623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1f954a3-8b80-462f-98ab-24c07c7d2fec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:43.291378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1f954a3-8b80-462f-98ab-24c07c7d2fec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:43.291811 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1f954a3-8b80-462f-98ab-24c07c7d2fec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:43.418722 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c1f954a3-8b80-462f-98ab-24c07c7d2fec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:43.426837 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c1f954a3-8b80-462f-98ab-24c07c7d2fec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.147572 Jul 25 08:50:43.427412 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 331/623] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:43 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:44.447260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-016fdd0a-9af9-4c44-95c5-9abdec2fc17a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:44.447865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-016fdd0a-9af9-4c44-95c5-9abdec2fc17a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:44.450271 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=52 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:44.456146 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-016fdd0a-9af9-4c44-95c5-9abdec2fc17a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:44.456610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-016fdd0a-9af9-4c44-95c5-9abdec2fc17a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:44.457369 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-016fdd0a-9af9-4c44-95c5-9abdec2fc17a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:44.457800 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-016fdd0a-9af9-4c44-95c5-9abdec2fc17a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:44.745414 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-016fdd0a-9af9-4c44-95c5-9abdec2fc17a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:44.753390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-016fdd0a-9af9-4c44-95c5-9abdec2fc17a tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.309959 Jul 25 08:50:44.754234 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 293/624] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:44 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:45.778734 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ba35d552-c816-40c6-8ae3-6a439c0eb9c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:45.779324 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ba35d552-c816-40c6-8ae3-6a439c0eb9c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:45.786259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba35d552-c816-40c6-8ae3-6a439c0eb9c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:45.786707 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba35d552-c816-40c6-8ae3-6a439c0eb9c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:45.787474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba35d552-c816-40c6-8ae3-6a439c0eb9c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:45.787907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba35d552-c816-40c6-8ae3-6a439c0eb9c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:45.912451 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ba35d552-c816-40c6-8ae3-6a439c0eb9c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:45.919860 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ba35d552-c816-40c6-8ae3-6a439c0eb9c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.144944 Jul 25 08:50:45.920420 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 332/625] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:45 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:46.319722 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2ed1b45c-8d37-4903-96c2-9d88c0a6aae6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:46.320361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2ed1b45c-8d37-4903-96c2-9d88c0a6aae6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:46.326808 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ed1b45c-8d37-4903-96c2-9d88c0a6aae6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:46.327269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ed1b45c-8d37-4903-96c2-9d88c0a6aae6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:46.328044 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ed1b45c-8d37-4903-96c2-9d88c0a6aae6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:46.328471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2ed1b45c-8d37-4903-96c2-9d88c0a6aae6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:46.346979 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:46.466177 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2ed1b45c-8d37-4903-96c2-9d88c0a6aae6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:46.474517 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2ed1b45c-8d37-4903-96c2-9d88c0a6aae6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1595 microversion: 2.1 time: 0.158560 Jul 25 08:50:46.475080 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 294/626] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:46 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:46.940540 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-352d902b-1a0a-4c43-84ec-6490cc7020eb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:46.941142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-352d902b-1a0a-4c43-84ec-6490cc7020eb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:46.947574 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-352d902b-1a0a-4c43-84ec-6490cc7020eb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:46.948034 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-352d902b-1a0a-4c43-84ec-6490cc7020eb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:46.948835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-352d902b-1a0a-4c43-84ec-6490cc7020eb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:46.949275 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-352d902b-1a0a-4c43-84ec-6490cc7020eb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:47.245359 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-352d902b-1a0a-4c43-84ec-6490cc7020eb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:47.253844 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-352d902b-1a0a-4c43-84ec-6490cc7020eb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1364 microversion: 2.1 time: 0.317564 Jul 25 08:50:47.254421 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 333/627] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:46 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:48.274615 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9c12d857-74a6-444f-a559-482e1c5e8802 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:48.275225 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9c12d857-74a6-444f-a559-482e1c5e8802 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:48.282363 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c12d857-74a6-444f-a559-482e1c5e8802 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:48.282817 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c12d857-74a6-444f-a559-482e1c5e8802 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:48.283590 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c12d857-74a6-444f-a559-482e1c5e8802 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:48.284030 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c12d857-74a6-444f-a559-482e1c5e8802 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:48.407616 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-0fc006ae-7d52-4803-b6df-56ace2e24465 req-29064c44-e9ad-448a-866e-f0b791612462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d74c6940-419a-4a70-bc74-9e4536cf9805", "tag": "c243097a-4313-4fd5-ad41-f6f18a03b006"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:48.418767 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-0fc006ae-7d52-4803-b6df-56ace2e24465 req-29064c44-e9ad-448a-866e-f0b791612462 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:48.419728 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-0fc006ae-7d52-4803-b6df-56ace2e24465 req-29064c44-e9ad-448a-866e-f0b791612462 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:48.438188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-0fc006ae-7d52-4803-b6df-56ace2e24465 req-29064c44-e9ad-448a-866e-f0b791612462 service nova] Creating event network-changed:c243097a-4313-4fd5-ad41-f6f18a03b006 for instance d74c6940-419a-4a70-bc74-9e4536cf9805 on hv-cinder-85084 Jul 25 08:50:48.444296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-0fc006ae-7d52-4803-b6df-56ace2e24465 req-29064c44-e9ad-448a-866e-f0b791612462 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041273 Jul 25 08:50:48.447963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 334/628] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:50:48.459370 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9c12d857-74a6-444f-a559-482e1c5e8802 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:48.466950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9c12d857-74a6-444f-a559-482e1c5e8802 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1554 microversion: 2.1 time: 0.196225 Jul 25 08:50:48.472953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 295/629] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:48 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:48.490419 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d4ec7504-0d1b-40d5-951f-cf740f7592b9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:48.491001 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d4ec7504-0d1b-40d5-951f-cf740f7592b9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:48.497635 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4ec7504-0d1b-40d5-951f-cf740f7592b9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:48.498088 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4ec7504-0d1b-40d5-951f-cf740f7592b9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:48.498864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4ec7504-0d1b-40d5-951f-cf740f7592b9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:48.499300 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4ec7504-0d1b-40d5-951f-cf740f7592b9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:48.631033 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d4ec7504-0d1b-40d5-951f-cf740f7592b9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144943 Jul 25 08:50:48.632165 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 335/630] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Jul 25 08:50:48 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:50:49.745541 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-72e1e3bb-b067-4fdd-95b0-23dd613f17a4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:49.746045 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-72e1e3bb-b067-4fdd-95b0-23dd613f17a4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:49.752907 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72e1e3bb-b067-4fdd-95b0-23dd613f17a4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:49.753359 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72e1e3bb-b067-4fdd-95b0-23dd613f17a4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:49.754580 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72e1e3bb-b067-4fdd-95b0-23dd613f17a4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:49.755021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72e1e3bb-b067-4fdd-95b0-23dd613f17a4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:49.899217 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.objects.instance [None req-72e1e3bb-b067-4fdd-95b0-23dd613f17a4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lazy-loading 'services' on Instance uuid 51c617f8-5881-4ef1-a9d2-2031c4cb3530 {{(pid=124234) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:50:50.060846 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a915b4f8-eb6a-49e7-a677-85848e960397 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1636106966"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:50.061674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a915b4f8-eb6a-49e7-a677-85848e960397 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:50.068123 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-72e1e3bb-b067-4fdd-95b0-23dd613f17a4 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530/os-volume_attachments/2fcaa51f-5a2a-499e-9d0e-2784446f64f6" status: 202 len: 0 microversion: 2.1 time: 0.327333 Jul 25 08:50:50.069101 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 296/631] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:50:49 2022] DELETE /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530/os-volume_attachments/2fcaa51f-5a2a-499e-9d0e-2784446f64f6 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:50:50.069407 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a915b4f8-eb6a-49e7-a677-85848e960397 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:50.070000 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a915b4f8-eb6a-49e7-a677-85848e960397 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:50.070883 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a915b4f8-eb6a-49e7-a677-85848e960397 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:50.071424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a915b4f8-eb6a-49e7-a677-85848e960397 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:50.221665 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.network.security_group_api [None req-a915b4f8-eb6a-49e7-a677-85848e960397 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Adding security group 80e09a9e-a28f-497d-b870-d7b93bada320 to port c243097a-4313-4fd5-ad41-f6f18a03b006 Jul 25 08:50:50.465556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-1b0f5c7e-cbe3-458e-819d-56104b27ea31 req-5bddd894-0051-422d-aa10-a1a129febe0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5263978-0aac-41bf-adad-05221bb69a08", "tag": "702582ed-3157-4dee-b38e-d158d8ec1b75"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:50.477120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-1b0f5c7e-cbe3-458e-819d-56104b27ea31 req-5bddd894-0051-422d-aa10-a1a129febe0a service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:50.477889 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-1b0f5c7e-cbe3-458e-819d-56104b27ea31 req-5bddd894-0051-422d-aa10-a1a129febe0a service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:50.491749 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-1b0f5c7e-cbe3-458e-819d-56104b27ea31 req-5bddd894-0051-422d-aa10-a1a129febe0a service nova] Creating event network-changed:702582ed-3157-4dee-b38e-d158d8ec1b75 for instance d5263978-0aac-41bf-adad-05221bb69a08 on hv-cinder-85084 Jul 25 08:50:50.496809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-1b0f5c7e-cbe3-458e-819d-56104b27ea31 req-5bddd894-0051-422d-aa10-a1a129febe0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035318 Jul 25 08:50:50.497503 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 297/632] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:50:50.582155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a915b4f8-eb6a-49e7-a677-85848e960397 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "POST /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/action" status: 202 len: 0 microversion: 2.1 time: 0.526602 Jul 25 08:50:50.585929 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 336/633] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:50:50 2022] POST /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 08:50:50.595347 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-cf5cdd84-d43d-4f2c-8c7c-86d6918b77a5 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:50.596138 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-cf5cdd84-d43d-4f2c-8c7c-86d6918b77a5 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:50.605724 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf5cdd84-d43d-4f2c-8c7c-86d6918b77a5 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:50.606570 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf5cdd84-d43d-4f2c-8c7c-86d6918b77a5 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:50.607602 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf5cdd84-d43d-4f2c-8c7c-86d6918b77a5 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:50.608259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf5cdd84-d43d-4f2c-8c7c-86d6918b77a5 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:50.766232 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-cf5cdd84-d43d-4f2c-8c7c-86d6918b77a5 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:50.775799 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-cf5cdd84-d43d-4f2c-8c7c-86d6918b77a5 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1761 microversion: 2.1 time: 0.187389 Jul 25 08:50:50.776792 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 298/634] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:50 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1761 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:52.273951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f39671f0-7bb3-4d09-b480-1ae91f37f79c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:52.274452 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f39671f0-7bb3-4d09-b480-1ae91f37f79c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:52.280493 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f39671f0-7bb3-4d09-b480-1ae91f37f79c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:52.281154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f39671f0-7bb3-4d09-b480-1ae91f37f79c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:52.281910 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f39671f0-7bb3-4d09-b480-1ae91f37f79c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:52.282342 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f39671f0-7bb3-4d09-b480-1ae91f37f79c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:52.286396 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:52.307712 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f39671f0-7bb3-4d09-b480-1ae91f37f79c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:50:52.382516 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f39671f0-7bb3-4d09-b480-1ae91f37f79c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 204 len: 0 microversion: 2.1 time: 0.112655 Jul 25 08:50:52.383022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 337/635] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:50:52 2022] DELETE /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:50:52.391826 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-272356d0-ca04-44dc-a2ec-15f72ef2400b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:52.392449 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-272356d0-ca04-44dc-a2ec-15f72ef2400b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:52.399034 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-272356d0-ca04-44dc-a2ec-15f72ef2400b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:52.399490 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-272356d0-ca04-44dc-a2ec-15f72ef2400b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:52.400252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-272356d0-ca04-44dc-a2ec-15f72ef2400b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:52.400728 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-272356d0-ca04-44dc-a2ec-15f72ef2400b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:52.523655 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-99133b5b-fab7-4e13-9c51-4c2441a0ac58 req-29a552ad-54b6-4049-aaea-e0aa9f48e3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d74c6940-419a-4a70-bc74-9e4536cf9805", "tag": "c243097a-4313-4fd5-ad41-f6f18a03b006"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:52.534127 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-99133b5b-fab7-4e13-9c51-4c2441a0ac58 req-29a552ad-54b6-4049-aaea-e0aa9f48e3a4 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:52.534616 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-99133b5b-fab7-4e13-9c51-4c2441a0ac58 req-29a552ad-54b6-4049-aaea-e0aa9f48e3a4 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:52.534874 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-272356d0-ca04-44dc-a2ec-15f72ef2400b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:52.542485 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-272356d0-ca04-44dc-a2ec-15f72ef2400b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1511 microversion: 2.1 time: 0.154492 Jul 25 08:50:52.543054 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 299/636] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:52 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:52.546203 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-99133b5b-fab7-4e13-9c51-4c2441a0ac58 req-29a552ad-54b6-4049-aaea-e0aa9f48e3a4 service nova] Creating event network-changed:c243097a-4313-4fd5-ad41-f6f18a03b006 for instance d74c6940-419a-4a70-bc74-9e4536cf9805 on hv-cinder-85084 Jul 25 08:50:52.551702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-99133b5b-fab7-4e13-9c51-4c2441a0ac58 req-29a552ad-54b6-4049-aaea-e0aa9f48e3a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032017 Jul 25 08:50:52.552320 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 338/637] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:50:52.701057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 08:50:52.701305 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Mon Jul 25 08:50:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 08:50:53.568167 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9c33f72a-3787-4d91-8c67-4d45f556d87f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:53.568854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9c33f72a-3787-4d91-8c67-4d45f556d87f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:53.577126 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c33f72a-3787-4d91-8c67-4d45f556d87f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:53.578239 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c33f72a-3787-4d91-8c67-4d45f556d87f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:53.579036 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c33f72a-3787-4d91-8c67-4d45f556d87f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:53.579498 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c33f72a-3787-4d91-8c67-4d45f556d87f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:53.717409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9c33f72a-3787-4d91-8c67-4d45f556d87f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:53.725230 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9c33f72a-3787-4d91-8c67-4d45f556d87f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1511 microversion: 2.1 time: 0.161025 Jul 25 08:50:53.725807 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 300/638] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:53 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:54.750020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c1457893-14b4-41bd-881e-7bd20171ff3c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:54.750774 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c1457893-14b4-41bd-881e-7bd20171ff3c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:54.757484 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1457893-14b4-41bd-881e-7bd20171ff3c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:54.757927 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1457893-14b4-41bd-881e-7bd20171ff3c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:54.758683 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1457893-14b4-41bd-881e-7bd20171ff3c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:54.759110 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1457893-14b4-41bd-881e-7bd20171ff3c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:54.904152 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c1457893-14b4-41bd-881e-7bd20171ff3c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:50:54.912581 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c1457893-14b4-41bd-881e-7bd20171ff3c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 200 len: 1511 microversion: 2.1 time: 0.167785 Jul 25 08:50:54.913180 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 339/639] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:54 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:50:55.143100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-864aa30d-95b7-4fcb-85dd-9945cadbabfa req-685e0508-5a1c-46ee-a29d-42b51f5d61c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c617f8-5881-4ef1-a9d2-2031c4cb3530", "name": "network-vif-deleted", "tag": "a890aaec-1df4-4858-be7e-3764009f17a4"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:50:55.153795 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-864aa30d-95b7-4fcb-85dd-9945cadbabfa req-685e0508-5a1c-46ee-a29d-42b51f5d61c3 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:55.154240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-864aa30d-95b7-4fcb-85dd-9945cadbabfa req-685e0508-5a1c-46ee-a29d-42b51f5d61c3 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:55.165273 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-864aa30d-95b7-4fcb-85dd-9945cadbabfa req-685e0508-5a1c-46ee-a29d-42b51f5d61c3 service nova] Creating event network-vif-deleted:a890aaec-1df4-4858-be7e-3764009f17a4 for instance 51c617f8-5881-4ef1-a9d2-2031c4cb3530 on hv-cinder-85084 Jul 25 08:50:55.170216 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-864aa30d-95b7-4fcb-85dd-9945cadbabfa req-685e0508-5a1c-46ee-a29d-42b51f5d61c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031287 Jul 25 08:50:55.170997 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 301/640] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:50:55.934839 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7c9a84be-76e1-4adf-a812-a957d20a7e1c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:50:55.935500 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7c9a84be-76e1-4adf-a812-a957d20a7e1c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: 51c617f8-5881-4ef1-a9d2-2031c4cb3530] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:50:55.942750 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c9a84be-76e1-4adf-a812-a957d20a7e1c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:55.943194 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c9a84be-76e1-4adf-a812-a957d20a7e1c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:55.943952 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c9a84be-76e1-4adf-a812-a957d20a7e1c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:50:55.944419 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c9a84be-76e1-4adf-a812-a957d20a7e1c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:50:55.958349 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-7c9a84be-76e1-4adf-a812-a957d20a7e1c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] HTTP exception thrown: Instance 51c617f8-5881-4ef1-a9d2-2031c4cb3530 could not be found. Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7c9a84be-76e1-4adf-a812-a957d20a7e1c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Request method failure captured: Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 HTTP/1.1 Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3ljbCifu3es7EFrHAaUiY8ddxhXv3E3e1f53qS9gR9NgiXgQVPibWX0pY_iFXuU-isPbc_cmPoVuoMtATw7aUiYHINSQ5j6wyJGCCG1aaHnbUZNzyhUG_fnEWgZ5DT2tpLZhNyrEnfnAe9BoNa4AjVkINjVgDWVK5AN8QLpRMx4PLx4 Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 1e76bc803d784442936b25a7ad36d564 Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1111178903 Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:50:55.960050 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e76bc803d784442936b25a7ad36d564"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1e76bc803d784442936b25a7ad36d564", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1e76bc803d784442936b25a7ad36d564"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e76bc803d784442936b25a7ad36d564"}]}] Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesSnapshotTestJSON-1111178903 Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 1e76bc803d784442936b25a7ad36d564 Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1111178903 Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesSnapshotTestJSON-1111178903-project Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 316c65a9dcd8472ab10b532537e5dad7 Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesSnapshotTestJSON-1111178903-project Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 51c617f8-5881-4ef1-a9d2-2031c4cb3530 could not be found. Jul 25 08:50:55.961702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '51c617f8-5881-4ef1-a9d2-2031c4cb3530'} Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c617f8-5881-4ef1-a9d2-2031c4cb3530 could not be found. Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:50:55.962723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c617f8-5881-4ef1-a9d2-2031c4cb3530 could not be found. Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c617f8-5881-4ef1-a9d2-2031c4cb3530 could not be found. Jul 25 08:50:55.964270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:50:55.965584 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7c9a84be-76e1-4adf-a812-a957d20a7e1c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Returning 404 to user: Instance 51c617f8-5881-4ef1-a9d2-2031c4cb3530 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:50:55.965584 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7c9a84be-76e1-4adf-a812-a957d20a7e1c tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530" status: 404 len: 111 microversion: 2.1 time: 0.030858 Jul 25 08:50:55.965584 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 340/641] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:50:55 2022] GET /compute/v2.1/servers/51c617f8-5881-4ef1-a9d2-2031c4cb3530 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:51:07.969914 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=17 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:07.970661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:07.974749 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-485112876", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "networks": [{"uuid": "43d25711-c8fd-4bad-bbe1-48fae01c4a82"}]}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:51:08.029007 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.network.neutron [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] validate_networks() for [('43d25711-c8fd-4bad-bbe1-48fae01c4a82', None, None, None, None, None)] {{(pid=124234) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:51:08.421449 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Flavor limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:51:08.421866 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Image limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:51:08.422341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Flavor pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:51:08.422787 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Image pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:51:08.423199 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:51:08.432004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:08.432452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:08.433285 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:08.433720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:08.450549 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Getting quotas for project 1e76bc803d784442936b25a7ad36d564. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:51:08.455145 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Getting quotas for user 316c65a9dcd8472ab10b532537e5dad7 and project 1e76bc803d784442936b25a7ad36d564. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:51:08.465905 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Going to run 1 instances... {{(pid=124234) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:51:08.468199 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124234) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:51:08.514757 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c406d3ff-4845-41ee-82ee-9f634a4a2b51 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547063 Jul 25 08:51:08.515426 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 302/642] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:51:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:51:08.526694 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-55053832-a273-4ed1-84fe-fbe1a292bf6f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:08.527335 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-55053832-a273-4ed1-84fe-fbe1a292bf6f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:08.529708 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:08.530520 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:08.589985 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-55053832-a273-4ed1-84fe-fbe1a292bf6f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:08.596808 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-55053832-a273-4ed1-84fe-fbe1a292bf6f tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1218 microversion: 2.1 time: 0.073959 Jul 25 08:51:08.597377 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 341/643] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:08 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:09.618837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0d1b0bc2-0089-42aa-90b2-dbe4e5402dca tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:09.619417 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0d1b0bc2-0089-42aa-90b2-dbe4e5402dca tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:09.626410 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0d1b0bc2-0089-42aa-90b2-dbe4e5402dca tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:09.626856 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0d1b0bc2-0089-42aa-90b2-dbe4e5402dca tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:09.627611 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0d1b0bc2-0089-42aa-90b2-dbe4e5402dca tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:09.628300 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0d1b0bc2-0089-42aa-90b2-dbe4e5402dca tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:09.691338 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0d1b0bc2-0089-42aa-90b2-dbe4e5402dca tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:09.701373 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0d1b0bc2-0089-42aa-90b2-dbe4e5402dca tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1278 microversion: 2.1 time: 0.087038 Jul 25 08:51:09.702139 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 303/644] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:09 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:10.723563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b863900e-fe2a-4bfc-aad9-a171ace8402a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:10.724199 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b863900e-fe2a-4bfc-aad9-a171ace8402a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:10.731528 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b863900e-fe2a-4bfc-aad9-a171ace8402a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:10.731912 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b863900e-fe2a-4bfc-aad9-a171ace8402a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:10.732719 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b863900e-fe2a-4bfc-aad9-a171ace8402a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:10.733158 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b863900e-fe2a-4bfc-aad9-a171ace8402a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:10.864480 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b863900e-fe2a-4bfc-aad9-a171ace8402a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:10.872447 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b863900e-fe2a-4bfc-aad9-a171ace8402a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.152807 Jul 25 08:51:10.873071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 342/645] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:10 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:11.012995 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-a97c2262-074c-4f65-b85b-480752a85515 req-cbccae03-528f-4ad2-b7ed-8dc3f1184eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0960b49-0e43-45f0-a793-72d2fd00ef1b", "tag": "26790a9e-bec0-42f5-98c3-40c574f2fae2"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:51:11.025018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-a97c2262-074c-4f65-b85b-480752a85515 req-cbccae03-528f-4ad2-b7ed-8dc3f1184eaa service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:11.025881 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-a97c2262-074c-4f65-b85b-480752a85515 req-cbccae03-528f-4ad2-b7ed-8dc3f1184eaa service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:11.040540 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-a97c2262-074c-4f65-b85b-480752a85515 req-cbccae03-528f-4ad2-b7ed-8dc3f1184eaa service nova] Creating event network-changed:26790a9e-bec0-42f5-98c3-40c574f2fae2 for instance b0960b49-0e43-45f0-a793-72d2fd00ef1b on hv-cinder-85084 Jul 25 08:51:11.045510 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-a97c2262-074c-4f65-b85b-480752a85515 req-cbccae03-528f-4ad2-b7ed-8dc3f1184eaa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036103 Jul 25 08:51:11.046096 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 304/646] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:51:11.893155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-47d5afdc-48d9-45d3-9a99-6da74b0ca75b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:11.893759 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-47d5afdc-48d9-45d3-9a99-6da74b0ca75b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:11.900275 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-47d5afdc-48d9-45d3-9a99-6da74b0ca75b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:11.900763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-47d5afdc-48d9-45d3-9a99-6da74b0ca75b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:11.901528 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-47d5afdc-48d9-45d3-9a99-6da74b0ca75b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:11.901970 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-47d5afdc-48d9-45d3-9a99-6da74b0ca75b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:12.034752 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-47d5afdc-48d9-45d3-9a99-6da74b0ca75b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:12.042171 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-47d5afdc-48d9-45d3-9a99-6da74b0ca75b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.152891 Jul 25 08:51:12.042738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 343/647] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:11 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:13.064788 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-78f2df06-9259-4690-accf-836fc01220f9 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:13.065415 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-78f2df06-9259-4690-accf-836fc01220f9 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:13.071674 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-78f2df06-9259-4690-accf-836fc01220f9 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:13.072122 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-78f2df06-9259-4690-accf-836fc01220f9 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:13.072914 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-78f2df06-9259-4690-accf-836fc01220f9 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:13.073348 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-78f2df06-9259-4690-accf-836fc01220f9 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:13.207867 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-78f2df06-9259-4690-accf-836fc01220f9 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:13.215390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-78f2df06-9259-4690-accf-836fc01220f9 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.155789 Jul 25 08:51:13.215960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 305/648] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:13 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:14.235869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-742ff7f4-9204-4431-b1db-f4ea422bc279 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:14.236472 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-742ff7f4-9204-4431-b1db-f4ea422bc279 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:14.243265 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-742ff7f4-9204-4431-b1db-f4ea422bc279 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:14.243745 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-742ff7f4-9204-4431-b1db-f4ea422bc279 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:14.244515 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-742ff7f4-9204-4431-b1db-f4ea422bc279 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:14.244979 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-742ff7f4-9204-4431-b1db-f4ea422bc279 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:14.373985 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-742ff7f4-9204-4431-b1db-f4ea422bc279 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:14.382213 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-742ff7f4-9204-4431-b1db-f4ea422bc279 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.150182 Jul 25 08:51:14.382775 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 344/649] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:14 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:15.403246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e7e048f9-0847-469a-87e9-281ee0d7fd9e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:15.403978 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e7e048f9-0847-469a-87e9-281ee0d7fd9e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:15.411020 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7e048f9-0847-469a-87e9-281ee0d7fd9e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:15.411464 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7e048f9-0847-469a-87e9-281ee0d7fd9e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:15.412220 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7e048f9-0847-469a-87e9-281ee0d7fd9e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:15.412676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7e048f9-0847-469a-87e9-281ee0d7fd9e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:15.552161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e7e048f9-0847-469a-87e9-281ee0d7fd9e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:15.560026 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e7e048f9-0847-469a-87e9-281ee0d7fd9e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.160481 Jul 25 08:51:15.560537 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 306/650] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:15 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:16.581723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-079d7ae7-b44a-45f7-84d8-319482f81fc6 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:16.582245 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-079d7ae7-b44a-45f7-84d8-319482f81fc6 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:16.588884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-079d7ae7-b44a-45f7-84d8-319482f81fc6 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:16.590331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-079d7ae7-b44a-45f7-84d8-319482f81fc6 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:16.590331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-079d7ae7-b44a-45f7-84d8-319482f81fc6 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:16.590546 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-079d7ae7-b44a-45f7-84d8-319482f81fc6 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:16.728729 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-079d7ae7-b44a-45f7-84d8-319482f81fc6 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:16.736242 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-079d7ae7-b44a-45f7-84d8-319482f81fc6 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.159034 Jul 25 08:51:16.736843 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 345/651] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:16 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:17.757827 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c68413fa-5773-4734-b1ea-abc64c53a870 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:17.758441 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c68413fa-5773-4734-b1ea-abc64c53a870 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:17.765648 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c68413fa-5773-4734-b1ea-abc64c53a870 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:17.766097 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c68413fa-5773-4734-b1ea-abc64c53a870 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:17.766860 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c68413fa-5773-4734-b1ea-abc64c53a870 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:17.767293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c68413fa-5773-4734-b1ea-abc64c53a870 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:17.899398 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c68413fa-5773-4734-b1ea-abc64c53a870 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:17.907439 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c68413fa-5773-4734-b1ea-abc64c53a870 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.153450 Jul 25 08:51:17.908008 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 307/652] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:17 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:18.928489 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8001fb13-4f4f-4e11-ab41-4226893a6565 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:18.929053 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8001fb13-4f4f-4e11-ab41-4226893a6565 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:18.931445 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:18.937509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8001fb13-4f4f-4e11-ab41-4226893a6565 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:18.938037 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8001fb13-4f4f-4e11-ab41-4226893a6565 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:18.939146 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8001fb13-4f4f-4e11-ab41-4226893a6565 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:18.939146 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8001fb13-4f4f-4e11-ab41-4226893a6565 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:19.078651 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8001fb13-4f4f-4e11-ab41-4226893a6565 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:19.086165 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8001fb13-4f4f-4e11-ab41-4226893a6565 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.161590 Jul 25 08:51:19.086734 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 346/653] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:18 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:19.252524 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-64dded57-a675-4df4-a6af-80fc726f743c req-e2f385f9-0caa-494a-9748-a86848298dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0960b49-0e43-45f0-a793-72d2fd00ef1b", "name": "network-vif-plugged", "status": "completed", "tag": "26790a9e-bec0-42f5-98c3-40c574f2fae2"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:51:19.257669 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:19.258332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=6 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:19.266158 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-64dded57-a675-4df4-a6af-80fc726f743c req-e2f385f9-0caa-494a-9748-a86848298dd1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:19.266586 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-64dded57-a675-4df4-a6af-80fc726f743c req-e2f385f9-0caa-494a-9748-a86848298dd1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:19.277630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-64dded57-a675-4df4-a6af-80fc726f743c req-e2f385f9-0caa-494a-9748-a86848298dd1 service nova] Creating event network-vif-plugged:26790a9e-bec0-42f5-98c3-40c574f2fae2 for instance b0960b49-0e43-45f0-a793-72d2fd00ef1b on hv-cinder-85084 Jul 25 08:51:19.283103 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-64dded57-a675-4df4-a6af-80fc726f743c req-e2f385f9-0caa-494a-9748-a86848298dd1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Jul 25 08:51:19.283879 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 308/654] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:51:20.107153 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5e76d7ff-ffb5-4240-9be1-ff1d2d7b4990 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:20.107716 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5e76d7ff-ffb5-4240-9be1-ff1d2d7b4990 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:20.114750 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5e76d7ff-ffb5-4240-9be1-ff1d2d7b4990 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:20.115192 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5e76d7ff-ffb5-4240-9be1-ff1d2d7b4990 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:20.115943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5e76d7ff-ffb5-4240-9be1-ff1d2d7b4990 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:20.116370 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5e76d7ff-ffb5-4240-9be1-ff1d2d7b4990 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:20.246378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5e76d7ff-ffb5-4240-9be1-ff1d2d7b4990 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:20.254559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5e76d7ff-ffb5-4240-9be1-ff1d2d7b4990 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.151322 Jul 25 08:51:20.255122 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 347/655] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:20 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:21.275277 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d3b6f8ae-39a2-4e01-8680-1c8ce13c4ec0 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:21.275885 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d3b6f8ae-39a2-4e01-8680-1c8ce13c4ec0 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:21.282606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d3b6f8ae-39a2-4e01-8680-1c8ce13c4ec0 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:21.283050 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d3b6f8ae-39a2-4e01-8680-1c8ce13c4ec0 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:21.283821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d3b6f8ae-39a2-4e01-8680-1c8ce13c4ec0 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:21.284232 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d3b6f8ae-39a2-4e01-8680-1c8ce13c4ec0 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:21.415005 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d3b6f8ae-39a2-4e01-8680-1c8ce13c4ec0 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:21.422624 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d3b6f8ae-39a2-4e01-8680-1c8ce13c4ec0 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.152072 Jul 25 08:51:21.423197 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 309/656] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:21 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:22.444144 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a8fea567-ba63-4c4e-b9b9-92835ee10d6a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:22.444835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a8fea567-ba63-4c4e-b9b9-92835ee10d6a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:22.452020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8fea567-ba63-4c4e-b9b9-92835ee10d6a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:22.452597 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8fea567-ba63-4c4e-b9b9-92835ee10d6a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:22.453411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8fea567-ba63-4c4e-b9b9-92835ee10d6a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:22.453848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8fea567-ba63-4c4e-b9b9-92835ee10d6a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:22.590478 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a8fea567-ba63-4c4e-b9b9-92835ee10d6a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:22.598784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a8fea567-ba63-4c4e-b9b9-92835ee10d6a tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1506 microversion: 2.1 time: 0.158924 Jul 25 08:51:22.599365 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 348/657] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:22 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:22.619721 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-16efe8f4-acd1-489e-ac51-56f725d655e5 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7c97173-91dc-4168-a1bc-821b9c75456a", "device": "/dev/sdb"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:51:22.622531 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-16efe8f4-acd1-489e-ac51-56f725d655e5 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:22.629395 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-16efe8f4-acd1-489e-ac51-56f725d655e5 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:22.629828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-16efe8f4-acd1-489e-ac51-56f725d655e5 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:22.630589 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-16efe8f4-acd1-489e-ac51-56f725d655e5 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:22.631014 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-16efe8f4-acd1-489e-ac51-56f725d655e5 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:22.880435 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-16efe8f4-acd1-489e-ac51-56f725d655e5 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "POST /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264486 Jul 25 08:51:22.881274 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 310/658] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:51:22 2022] POST /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:51:30.570492 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7ac07057-6852-4420-866a-98b49365b8f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:30.571080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7ac07057-6852-4420-866a-98b49365b8f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:30.577221 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ac07057-6852-4420-866a-98b49365b8f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:30.577667 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ac07057-6852-4420-866a-98b49365b8f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:30.578464 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ac07057-6852-4420-866a-98b49365b8f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:30.578889 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ac07057-6852-4420-866a-98b49365b8f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:30.601075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7ac07057-6852-4420-866a-98b49365b8f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/ips" status: 200 len: 153 microversion: 2.20 time: 0.034634 Jul 25 08:51:30.601631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 349/659] 10.222.0.52 () {60 vars in 1289 bytes} [Mon Jul 25 08:51:30 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/ips => generated 153 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:51:33.485360 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a4ce40f6-ce4c-40c0-a883-8a5e176c01c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:51:33.490763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a4ce40f6-ce4c-40c0-a883-8a5e176c01c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:33.490763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:33.490763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:33.495725 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a4ce40f6-ce4c-40c0-a883-8a5e176c01c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:33.496175 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a4ce40f6-ce4c-40c0-a883-8a5e176c01c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:33.496979 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a4ce40f6-ce4c-40c0-a883-8a5e176c01c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:33.497411 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a4ce40f6-ce4c-40c0-a883-8a5e176c01c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:33.526073 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.objects.instance [None req-a4ce40f6-ce4c-40c0-a883-8a5e176c01c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lazy-loading 'flavor' on Instance uuid 7b4a347c-82ac-48e1-a31e-45f7eb643cda {{(pid=124234) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:51:33.732145 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a4ce40f6-ce4c-40c0-a883-8a5e176c01c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "POST /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/action" status: 202 len: 0 microversion: 2.20 time: 0.252033 Jul 25 08:51:33.733009 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 311/660] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Jul 25 08:51:33 2022] POST /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 08:51:33.742724 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4df169cc-a484-43e7-b105-293c0a975885 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:33.743333 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4df169cc-a484-43e7-b105-293c0a975885 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:33.750252 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4df169cc-a484-43e7-b105-293c0a975885 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:33.750753 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4df169cc-a484-43e7-b105-293c0a975885 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:33.751513 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4df169cc-a484-43e7-b105-293c0a975885 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:33.752362 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4df169cc-a484-43e7-b105-293c0a975885 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:33.902727 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4df169cc-a484-43e7-b105-293c0a975885 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:33.911082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4df169cc-a484-43e7-b105-293c0a975885 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:33.912619 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4df169cc-a484-43e7-b105-293c0a975885 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:33.913767 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4df169cc-a484-43e7-b105-293c0a975885 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.174911 Jul 25 08:51:33.914317 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 350/661] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:33 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:34.939437 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-41a338c4-880b-4fba-beda-6ad240112fa9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:34.940018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-41a338c4-880b-4fba-beda-6ad240112fa9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:34.947230 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-41a338c4-880b-4fba-beda-6ad240112fa9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:34.947721 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-41a338c4-880b-4fba-beda-6ad240112fa9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:34.948446 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-41a338c4-880b-4fba-beda-6ad240112fa9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:34.949044 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-41a338c4-880b-4fba-beda-6ad240112fa9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:35.090219 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-41a338c4-880b-4fba-beda-6ad240112fa9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:35.099590 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-41a338c4-880b-4fba-beda-6ad240112fa9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:35.101124 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-41a338c4-880b-4fba-beda-6ad240112fa9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:35.102281 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-41a338c4-880b-4fba-beda-6ad240112fa9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.167700 Jul 25 08:51:35.102839 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 312/662] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:34 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:51:36.127768 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b61e51cb-d6ae-4207-b69a-60adc37ea16f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:36.128488 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b61e51cb-d6ae-4207-b69a-60adc37ea16f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:36.135282 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b61e51cb-d6ae-4207-b69a-60adc37ea16f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:36.135730 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b61e51cb-d6ae-4207-b69a-60adc37ea16f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:36.136598 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b61e51cb-d6ae-4207-b69a-60adc37ea16f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:36.137206 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b61e51cb-d6ae-4207-b69a-60adc37ea16f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:36.271796 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b61e51cb-d6ae-4207-b69a-60adc37ea16f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:36.280848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b61e51cb-d6ae-4207-b69a-60adc37ea16f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:36.282444 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b61e51cb-d6ae-4207-b69a-60adc37ea16f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:36.283647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b61e51cb-d6ae-4207-b69a-60adc37ea16f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.160661 Jul 25 08:51:36.284311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 351/663] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:36 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:37.307259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a62b2a8e-20d8-441c-8969-7d33313e9053 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:37.307655 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a62b2a8e-20d8-441c-8969-7d33313e9053 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:37.314195 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a62b2a8e-20d8-441c-8969-7d33313e9053 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:37.314649 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a62b2a8e-20d8-441c-8969-7d33313e9053 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:37.315397 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a62b2a8e-20d8-441c-8969-7d33313e9053 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:37.315831 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a62b2a8e-20d8-441c-8969-7d33313e9053 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:37.449220 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a62b2a8e-20d8-441c-8969-7d33313e9053 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:37.457913 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a62b2a8e-20d8-441c-8969-7d33313e9053 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:37.459422 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a62b2a8e-20d8-441c-8969-7d33313e9053 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:37.460608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a62b2a8e-20d8-441c-8969-7d33313e9053 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.158100 Jul 25 08:51:37.461184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 313/664] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:37 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:38.484532 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-22bd558d-dc9a-40c8-9590-ab8b6e80dcde tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:38.485171 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-22bd558d-dc9a-40c8-9590-ab8b6e80dcde tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:38.491721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22bd558d-dc9a-40c8-9590-ab8b6e80dcde tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:38.492173 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22bd558d-dc9a-40c8-9590-ab8b6e80dcde tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:38.492965 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22bd558d-dc9a-40c8-9590-ab8b6e80dcde tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:38.493399 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22bd558d-dc9a-40c8-9590-ab8b6e80dcde tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:38.625303 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-22bd558d-dc9a-40c8-9590-ab8b6e80dcde tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:38.627766 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=63 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:38.634690 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-22bd558d-dc9a-40c8-9590-ab8b6e80dcde tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:38.636178 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-22bd558d-dc9a-40c8-9590-ab8b6e80dcde tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:38.637353 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-22bd558d-dc9a-40c8-9590-ab8b6e80dcde tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.156785 Jul 25 08:51:38.637914 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 352/665] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:38 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:39.661410 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-51818732-e1c8-49b1-a1e9-a2586e7bd6cb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:39.662078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-51818732-e1c8-49b1-a1e9-a2586e7bd6cb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:39.669278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-51818732-e1c8-49b1-a1e9-a2586e7bd6cb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:39.669721 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-51818732-e1c8-49b1-a1e9-a2586e7bd6cb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:39.670493 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-51818732-e1c8-49b1-a1e9-a2586e7bd6cb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:39.670930 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-51818732-e1c8-49b1-a1e9-a2586e7bd6cb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:39.807781 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-51818732-e1c8-49b1-a1e9-a2586e7bd6cb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:39.816587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-51818732-e1c8-49b1-a1e9-a2586e7bd6cb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:39.818109 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-51818732-e1c8-49b1-a1e9-a2586e7bd6cb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:39.819276 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-51818732-e1c8-49b1-a1e9-a2586e7bd6cb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.162412 Jul 25 08:51:39.819840 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 314/666] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:39 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:40.845857 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a3e9af15-f21d-4941-87c8-78ead3e46f6f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:40.846532 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a3e9af15-f21d-4941-87c8-78ead3e46f6f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:40.850664 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=27 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:40.860107 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3e9af15-f21d-4941-87c8-78ead3e46f6f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:40.860547 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3e9af15-f21d-4941-87c8-78ead3e46f6f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:40.862942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3e9af15-f21d-4941-87c8-78ead3e46f6f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:40.862942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3e9af15-f21d-4941-87c8-78ead3e46f6f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:40.994699 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a3e9af15-f21d-4941-87c8-78ead3e46f6f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:41.003817 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a3e9af15-f21d-4941-87c8-78ead3e46f6f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:41.005350 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a3e9af15-f21d-4941-87c8-78ead3e46f6f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:41.006627 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a3e9af15-f21d-4941-87c8-78ead3e46f6f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.165986 Jul 25 08:51:41.007474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 353/667] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:40 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:51:42.029676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-189a8a07-e9b0-4208-93eb-d443a089d069 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:42.030347 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-189a8a07-e9b0-4208-93eb-d443a089d069 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:42.037050 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-189a8a07-e9b0-4208-93eb-d443a089d069 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:42.037504 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-189a8a07-e9b0-4208-93eb-d443a089d069 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:42.038280 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-189a8a07-e9b0-4208-93eb-d443a089d069 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:42.038757 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-189a8a07-e9b0-4208-93eb-d443a089d069 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:42.175450 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-189a8a07-e9b0-4208-93eb-d443a089d069 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:42.185321 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-189a8a07-e9b0-4208-93eb-d443a089d069 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:42.187969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-189a8a07-e9b0-4208-93eb-d443a089d069 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:42.189650 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-189a8a07-e9b0-4208-93eb-d443a089d069 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.163522 Jul 25 08:51:42.190590 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 315/668] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:42 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:43.217547 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b14e5fed-5419-41ad-a3cf-623d8c91e09e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:43.218808 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b14e5fed-5419-41ad-a3cf-623d8c91e09e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:43.225404 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b14e5fed-5419-41ad-a3cf-623d8c91e09e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:43.225850 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b14e5fed-5419-41ad-a3cf-623d8c91e09e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:43.226606 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b14e5fed-5419-41ad-a3cf-623d8c91e09e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:43.227032 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b14e5fed-5419-41ad-a3cf-623d8c91e09e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:43.362678 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b14e5fed-5419-41ad-a3cf-623d8c91e09e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:43.370677 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b14e5fed-5419-41ad-a3cf-623d8c91e09e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:43.372180 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b14e5fed-5419-41ad-a3cf-623d8c91e09e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:43.373366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b14e5fed-5419-41ad-a3cf-623d8c91e09e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.159716 Jul 25 08:51:43.373926 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 354/669] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:43 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:44.397626 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b9466ab2-892b-4422-b7e7-503f08776f51 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:44.398253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b9466ab2-892b-4422-b7e7-503f08776f51 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:44.407039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b9466ab2-892b-4422-b7e7-503f08776f51 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:44.407524 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b9466ab2-892b-4422-b7e7-503f08776f51 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:44.408293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b9466ab2-892b-4422-b7e7-503f08776f51 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:44.408859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b9466ab2-892b-4422-b7e7-503f08776f51 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:44.552592 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b9466ab2-892b-4422-b7e7-503f08776f51 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:44.560611 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b9466ab2-892b-4422-b7e7-503f08776f51 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:44.562137 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b9466ab2-892b-4422-b7e7-503f08776f51 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:44.563300 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b9466ab2-892b-4422-b7e7-503f08776f51 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.169577 Jul 25 08:51:44.563866 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 316/670] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:44 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:45.586725 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4fe23303-5978-48cb-a463-d49365e364f8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:45.587289 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4fe23303-5978-48cb-a463-d49365e364f8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:45.594473 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4fe23303-5978-48cb-a463-d49365e364f8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:45.594923 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4fe23303-5978-48cb-a463-d49365e364f8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:45.595689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4fe23303-5978-48cb-a463-d49365e364f8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:45.596192 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4fe23303-5978-48cb-a463-d49365e364f8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:45.954795 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4fe23303-5978-48cb-a463-d49365e364f8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:45.962621 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4fe23303-5978-48cb-a463-d49365e364f8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:45.964134 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4fe23303-5978-48cb-a463-d49365e364f8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:45.965305 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4fe23303-5978-48cb-a463-d49365e364f8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.382682 Jul 25 08:51:45.965861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 355/671] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:45 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:46.988890 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-74054db8-e239-42ed-84b6-9631cd65af1d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:46.989481 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-74054db8-e239-42ed-84b6-9631cd65af1d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:46.995935 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-74054db8-e239-42ed-84b6-9631cd65af1d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:46.996379 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-74054db8-e239-42ed-84b6-9631cd65af1d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:46.997170 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-74054db8-e239-42ed-84b6-9631cd65af1d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:46.997603 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-74054db8-e239-42ed-84b6-9631cd65af1d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:47.132942 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-74054db8-e239-42ed-84b6-9631cd65af1d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:47.141511 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-74054db8-e239-42ed-84b6-9631cd65af1d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:47.143024 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-74054db8-e239-42ed-84b6-9631cd65af1d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:47.144190 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-74054db8-e239-42ed-84b6-9631cd65af1d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.159228 Jul 25 08:51:47.144773 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 317/672] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:46 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:47.434506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dc278872-f7fd-4efc-85d6-8596748fe908 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:47.435010 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dc278872-f7fd-4efc-85d6-8596748fe908 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:47.441555 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dc278872-f7fd-4efc-85d6-8596748fe908 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:47.441998 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dc278872-f7fd-4efc-85d6-8596748fe908 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:47.442752 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dc278872-f7fd-4efc-85d6-8596748fe908 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:47.447877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dc278872-f7fd-4efc-85d6-8596748fe908 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:47.571117 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-dc278872-f7fd-4efc-85d6-8596748fe908 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lazy-loading 'services' on Instance uuid b0960b49-0e43-45f0-a793-72d2fd00ef1b {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:51:47.701454 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dc278872-f7fd-4efc-85d6-8596748fe908 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b/os-volume_attachments/c7c97173-91dc-4168-a1bc-821b9c75456a" status: 202 len: 0 microversion: 2.1 time: 0.270214 Jul 25 08:51:47.702591 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 356/673] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:51:47 2022] DELETE /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b/os-volume_attachments/c7c97173-91dc-4168-a1bc-821b9c75456a => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:51:48.167676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dab83b52-03a6-441b-aa64-e25d2755a5fa tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:48.168490 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dab83b52-03a6-441b-aa64-e25d2755a5fa tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:48.175828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dab83b52-03a6-441b-aa64-e25d2755a5fa tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:48.176275 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dab83b52-03a6-441b-aa64-e25d2755a5fa tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:48.177078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dab83b52-03a6-441b-aa64-e25d2755a5fa tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:48.177507 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dab83b52-03a6-441b-aa64-e25d2755a5fa tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:48.311560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dab83b52-03a6-441b-aa64-e25d2755a5fa tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:48.319445 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dab83b52-03a6-441b-aa64-e25d2755a5fa tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:48.320976 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dab83b52-03a6-441b-aa64-e25d2755a5fa tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:48.322122 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dab83b52-03a6-441b-aa64-e25d2755a5fa tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.158522 Jul 25 08:51:48.322665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 318/674] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:48 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:48.830913 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3fa00768-3391-49f7-b001-59daa6904e19 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:48.831550 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3fa00768-3391-49f7-b001-59daa6904e19 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:48.840435 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3fa00768-3391-49f7-b001-59daa6904e19 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:48.841208 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3fa00768-3391-49f7-b001-59daa6904e19 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:48.842391 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3fa00768-3391-49f7-b001-59daa6904e19 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:48.845960 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3fa00768-3391-49f7-b001-59daa6904e19 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:48.875802 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3fa00768-3391-49f7-b001-59daa6904e19 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:51:48.967845 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3fa00768-3391-49f7-b001-59daa6904e19 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 204 len: 0 microversion: 2.1 time: 0.141490 Jul 25 08:51:48.968467 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 357/675] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:51:48 2022] DELETE /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:51:48.976663 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-562d1a55-953e-448e-b4ef-cd35ff51e89b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:48.977282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-562d1a55-953e-448e-b4ef-cd35ff51e89b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:48.983457 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-562d1a55-953e-448e-b4ef-cd35ff51e89b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:48.983907 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-562d1a55-953e-448e-b4ef-cd35ff51e89b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:48.984718 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-562d1a55-953e-448e-b4ef-cd35ff51e89b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:48.985154 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-562d1a55-953e-448e-b4ef-cd35ff51e89b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:49.120929 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-562d1a55-953e-448e-b4ef-cd35ff51e89b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:49.130665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-562d1a55-953e-448e-b4ef-cd35ff51e89b tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1512 microversion: 2.1 time: 0.157596 Jul 25 08:51:49.131720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 319/676] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:48 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:49.348334 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b2cbe854-2fef-4b35-a674-03f5c401dd5f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:49.349003 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b2cbe854-2fef-4b35-a674-03f5c401dd5f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:49.355000 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b2cbe854-2fef-4b35-a674-03f5c401dd5f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:49.355441 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b2cbe854-2fef-4b35-a674-03f5c401dd5f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:49.356194 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b2cbe854-2fef-4b35-a674-03f5c401dd5f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:49.356649 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b2cbe854-2fef-4b35-a674-03f5c401dd5f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:49.497694 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b2cbe854-2fef-4b35-a674-03f5c401dd5f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:49.505736 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b2cbe854-2fef-4b35-a674-03f5c401dd5f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:49.507209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b2cbe854-2fef-4b35-a674-03f5c401dd5f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:49.508347 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b2cbe854-2fef-4b35-a674-03f5c401dd5f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.164886 Jul 25 08:51:49.508931 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 358/677] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:49 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:51:50.152319 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bd5174f4-e22c-4f09-b31f-81effc1064df tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:50.152950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bd5174f4-e22c-4f09-b31f-81effc1064df tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:50.159522 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd5174f4-e22c-4f09-b31f-81effc1064df tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:50.159970 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd5174f4-e22c-4f09-b31f-81effc1064df tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:50.160770 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd5174f4-e22c-4f09-b31f-81effc1064df tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:50.161202 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd5174f4-e22c-4f09-b31f-81effc1064df tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:50.290596 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bd5174f4-e22c-4f09-b31f-81effc1064df tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:50.298947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bd5174f4-e22c-4f09-b31f-81effc1064df tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1512 microversion: 2.1 time: 0.150430 Jul 25 08:51:50.299518 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 320/678] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:50 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:50.532115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4ce71702-9c32-4e70-9d4f-a38c1d13f87f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:50.533301 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4ce71702-9c32-4e70-9d4f-a38c1d13f87f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:50.539848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4ce71702-9c32-4e70-9d4f-a38c1d13f87f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:50.540322 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4ce71702-9c32-4e70-9d4f-a38c1d13f87f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:50.541130 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4ce71702-9c32-4e70-9d4f-a38c1d13f87f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:50.541692 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4ce71702-9c32-4e70-9d4f-a38c1d13f87f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:50.682287 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4ce71702-9c32-4e70-9d4f-a38c1d13f87f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:50.690244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4ce71702-9c32-4e70-9d4f-a38c1d13f87f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:50.692201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4ce71702-9c32-4e70-9d4f-a38c1d13f87f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:50.692911 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4ce71702-9c32-4e70-9d4f-a38c1d13f87f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.165487 Jul 25 08:51:50.693469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 359/679] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:50 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:51.319712 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-39048f74-86b4-4b29-ae85-06f420040a91 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:51.320370 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-39048f74-86b4-4b29-ae85-06f420040a91 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:51.327621 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-39048f74-86b4-4b29-ae85-06f420040a91 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:51.328076 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-39048f74-86b4-4b29-ae85-06f420040a91 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:51.328874 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-39048f74-86b4-4b29-ae85-06f420040a91 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:51.329307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-39048f74-86b4-4b29-ae85-06f420040a91 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:51.467919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-39048f74-86b4-4b29-ae85-06f420040a91 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:51.478092 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-39048f74-86b4-4b29-ae85-06f420040a91 tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1512 microversion: 2.1 time: 0.162443 Jul 25 08:51:51.478847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 321/680] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:51 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:51.716152 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ae1611d6-001b-4529-ad01-9be595d7b726 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:51.716797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ae1611d6-001b-4529-ad01-9be595d7b726 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:51.724237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ae1611d6-001b-4529-ad01-9be595d7b726 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:51.724710 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ae1611d6-001b-4529-ad01-9be595d7b726 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:51.725473 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ae1611d6-001b-4529-ad01-9be595d7b726 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:51.725898 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ae1611d6-001b-4529-ad01-9be595d7b726 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:51.904270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ae1611d6-001b-4529-ad01-9be595d7b726 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:51.913081 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ae1611d6-001b-4529-ad01-9be595d7b726 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:51.914588 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ae1611d6-001b-4529-ad01-9be595d7b726 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:51.915847 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ae1611d6-001b-4529-ad01-9be595d7b726 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.203665 Jul 25 08:51:51.916455 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 360/681] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:51 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:51.943633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-eeea9307-e977-441d-80d1-07f3ab5fbc84 req-66558494-ccdf-4cf1-91c7-d4dc85e30ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0960b49-0e43-45f0-a793-72d2fd00ef1b", "name": "network-vif-deleted", "tag": "26790a9e-bec0-42f5-98c3-40c574f2fae2"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:51:51.955270 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-eeea9307-e977-441d-80d1-07f3ab5fbc84 req-66558494-ccdf-4cf1-91c7-d4dc85e30ee8 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:51.955768 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-eeea9307-e977-441d-80d1-07f3ab5fbc84 req-66558494-ccdf-4cf1-91c7-d4dc85e30ee8 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:51.967194 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-eeea9307-e977-441d-80d1-07f3ab5fbc84 req-66558494-ccdf-4cf1-91c7-d4dc85e30ee8 service nova] Creating event network-vif-deleted:26790a9e-bec0-42f5-98c3-40c574f2fae2 for instance b0960b49-0e43-45f0-a793-72d2fd00ef1b on hv-cinder-85084 Jul 25 08:51:51.972501 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-eeea9307-e977-441d-80d1-07f3ab5fbc84 req-66558494-ccdf-4cf1-91c7-d4dc85e30ee8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131285 Jul 25 08:51:51.973108 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 322/682] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:51:52.499787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:52.500521 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:52.507070 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:52.507512 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:52.508274 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:52.508791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:52.540052 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:52.540484 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:52.540961 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lazy-loading 'fault' on Instance uuid b0960b49-0e43-45f0-a793-72d2fd00ef1b {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:51:52.586147 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c65a9dcd8472ab10b532537e5dad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e76bc803d784442936b25a7ad36d564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:52.595387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3fd5cc5d-c68f-416f-82e4-71e73c574dda tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 200 len: 1308 microversion: 2.1 time: 0.099902 Jul 25 08:51:52.596101 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 361/683] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:52 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:51:52.939877 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a999ad0c-80c2-4b00-a1ac-3fff91c59fac tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:52.940611 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a999ad0c-80c2-4b00-a1ac-3fff91c59fac tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:52.947395 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a999ad0c-80c2-4b00-a1ac-3fff91c59fac tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:52.947851 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a999ad0c-80c2-4b00-a1ac-3fff91c59fac tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:52.948655 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a999ad0c-80c2-4b00-a1ac-3fff91c59fac tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:52.949104 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a999ad0c-80c2-4b00-a1ac-3fff91c59fac tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:53.086724 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a999ad0c-80c2-4b00-a1ac-3fff91c59fac tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:53.095615 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a999ad0c-80c2-4b00-a1ac-3fff91c59fac tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:53.097161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a999ad0c-80c2-4b00-a1ac-3fff91c59fac tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:53.098328 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a999ad0c-80c2-4b00-a1ac-3fff91c59fac tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.162745 Jul 25 08:51:53.098883 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 323/684] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:52 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:53.621683 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-198eba2d-7cb7-43e8-b5eb-aa859c6fc76e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:53.622241 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-198eba2d-7cb7-43e8-b5eb-aa859c6fc76e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] [instance: b0960b49-0e43-45f0-a793-72d2fd00ef1b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:53.629272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-198eba2d-7cb7-43e8-b5eb-aa859c6fc76e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:53.629721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-198eba2d-7cb7-43e8-b5eb-aa859c6fc76e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:53.630503 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-198eba2d-7cb7-43e8-b5eb-aa859c6fc76e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:53.630941 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-198eba2d-7cb7-43e8-b5eb-aa859c6fc76e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:53.645427 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-198eba2d-7cb7-43e8-b5eb-aa859c6fc76e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] HTTP exception thrown: Instance b0960b49-0e43-45f0-a793-72d2fd00ef1b could not be found. Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-198eba2d-7cb7-43e8-b5eb-aa859c6fc76e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Request method failure captured: Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b HTTP/1.1 Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3ljbCifu3es7EFrHAaUiY8ddxhXv3E3e1f53qS9gR9NgiXgQVPibWX0pY_iFXuU-isPbc_cmPoVuoMtATw7aUiYHINSQ5j6wyJGCCG1aaHnbUZNzyhUG_fnEWgZ5DT2tpLZhNyrEnfnAe9BoNa4AjVkINjVgDWVK5AN8QLpRMx4PLx4 Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 1e76bc803d784442936b25a7ad36d564 Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1111178903 Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:51:53.647102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e76bc803d784442936b25a7ad36d564"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1e76bc803d784442936b25a7ad36d564", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1e76bc803d784442936b25a7ad36d564"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e76bc803d784442936b25a7ad36d564"}]}] Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesSnapshotTestJSON-1111178903 Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 1e76bc803d784442936b25a7ad36d564 Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1111178903 Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesSnapshotTestJSON-1111178903-project Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 316c65a9dcd8472ab10b532537e5dad7 Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesSnapshotTestJSON-1111178903-project Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance b0960b49-0e43-45f0-a793-72d2fd00ef1b could not be found. Jul 25 08:51:53.648533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': 'b0960b49-0e43-45f0-a793-72d2fd00ef1b'} Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0960b49-0e43-45f0-a793-72d2fd00ef1b could not be found. Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:51:53.649378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0960b49-0e43-45f0-a793-72d2fd00ef1b could not be found. Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0960b49-0e43-45f0-a793-72d2fd00ef1b could not be found. Jul 25 08:51:53.651280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:51:53.653306 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-198eba2d-7cb7-43e8-b5eb-aa859c6fc76e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] Returning 404 to user: Instance b0960b49-0e43-45f0-a793-72d2fd00ef1b could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:51:53.653306 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-198eba2d-7cb7-43e8-b5eb-aa859c6fc76e tempest-VolumesSnapshotTestJSON-1111178903 tempest-VolumesSnapshotTestJSON-1111178903-project] 10.222.0.52 "GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b" status: 404 len: 111 microversion: 2.1 time: 0.032660 Jul 25 08:51:53.653306 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 362/685] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:51:53 2022] GET /compute/v2.1/servers/b0960b49-0e43-45f0-a793-72d2fd00ef1b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:51:54.124191 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b8a0658b-2f8e-42a7-9b95-464687e4c13e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:54.125066 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b8a0658b-2f8e-42a7-9b95-464687e4c13e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:54.132107 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8a0658b-2f8e-42a7-9b95-464687e4c13e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:54.132554 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8a0658b-2f8e-42a7-9b95-464687e4c13e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:54.133335 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8a0658b-2f8e-42a7-9b95-464687e4c13e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:54.133768 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8a0658b-2f8e-42a7-9b95-464687e4c13e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:54.272049 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b8a0658b-2f8e-42a7-9b95-464687e4c13e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:54.283253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b8a0658b-2f8e-42a7-9b95-464687e4c13e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:54.284799 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b8a0658b-2f8e-42a7-9b95-464687e4c13e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:54.285959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b8a0658b-2f8e-42a7-9b95-464687e4c13e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.166169 Jul 25 08:51:54.286515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 324/686] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:54 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:55.310020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e4d022d8-3519-4676-bbea-93b431ce68ff tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:55.310619 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e4d022d8-3519-4676-bbea-93b431ce68ff tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:55.317894 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4d022d8-3519-4676-bbea-93b431ce68ff tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:55.318337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4d022d8-3519-4676-bbea-93b431ce68ff tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:55.319085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4d022d8-3519-4676-bbea-93b431ce68ff tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:55.319513 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4d022d8-3519-4676-bbea-93b431ce68ff tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:55.456513 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e4d022d8-3519-4676-bbea-93b431ce68ff tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:55.464548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e4d022d8-3519-4676-bbea-93b431ce68ff tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:55.466066 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e4d022d8-3519-4676-bbea-93b431ce68ff tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:55.467245 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e4d022d8-3519-4676-bbea-93b431ce68ff tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1746 microversion: 2.20 time: 0.161075 Jul 25 08:51:55.468292 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 363/687] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:55 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:56.492288 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-66535566-763b-4b7f-a457-a5d4b0b32c76 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:56.493222 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-66535566-763b-4b7f-a457-a5d4b0b32c76 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:56.502312 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-66535566-763b-4b7f-a457-a5d4b0b32c76 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:56.502759 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-66535566-763b-4b7f-a457-a5d4b0b32c76 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:56.503521 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-66535566-763b-4b7f-a457-a5d4b0b32c76 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:56.503955 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-66535566-763b-4b7f-a457-a5d4b0b32c76 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:56.635526 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-66535566-763b-4b7f-a457-a5d4b0b32c76 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:56.643568 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-66535566-763b-4b7f-a457-a5d4b0b32c76 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:56.645097 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-66535566-763b-4b7f-a457-a5d4b0b32c76 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:56.646240 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-66535566-763b-4b7f-a457-a5d4b0b32c76 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1746 microversion: 2.20 time: 0.158422 Jul 25 08:51:56.646797 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 325/688] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:56 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:57.669035 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-856d573b-5ced-4077-9444-492a8d593d4d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:57.669663 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-856d573b-5ced-4077-9444-492a8d593d4d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:57.676268 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-856d573b-5ced-4077-9444-492a8d593d4d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:57.676745 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-856d573b-5ced-4077-9444-492a8d593d4d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:57.677509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-856d573b-5ced-4077-9444-492a8d593d4d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:57.677939 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-856d573b-5ced-4077-9444-492a8d593d4d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:57.814025 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-856d573b-5ced-4077-9444-492a8d593d4d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:57.822041 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-856d573b-5ced-4077-9444-492a8d593d4d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:57.823535 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-856d573b-5ced-4077-9444-492a8d593d4d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:57.824726 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-856d573b-5ced-4077-9444-492a8d593d4d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1746 microversion: 2.20 time: 0.159736 Jul 25 08:51:57.825285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 364/689] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:57 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:51:58.848539 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0dc508a0-c7d4-4066-8439-91c22c9cc090 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:51:58.849162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0dc508a0-c7d4-4066-8439-91c22c9cc090 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:51:58.855807 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0dc508a0-c7d4-4066-8439-91c22c9cc090 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:58.856256 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0dc508a0-c7d4-4066-8439-91c22c9cc090 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:58.857056 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0dc508a0-c7d4-4066-8439-91c22c9cc090 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:51:58.857489 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0dc508a0-c7d4-4066-8439-91c22c9cc090 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:51:58.862331 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:58.993687 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0dc508a0-c7d4-4066-8439-91c22c9cc090 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:59.002655 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0dc508a0-c7d4-4066-8439-91c22c9cc090 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:59.004165 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0dc508a0-c7d4-4066-8439-91c22c9cc090 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:51:59.005740 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0dc508a0-c7d4-4066-8439-91c22c9cc090 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1746 microversion: 2.20 time: 0.160731 Jul 25 08:51:59.005944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 326/690] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:51:58 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:00.028801 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9e2e1f3b-7177-4c1c-b6ce-19f3404d3dcc tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:00.029436 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9e2e1f3b-7177-4c1c-b6ce-19f3404d3dcc tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:00.035835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e2e1f3b-7177-4c1c-b6ce-19f3404d3dcc tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:00.036267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e2e1f3b-7177-4c1c-b6ce-19f3404d3dcc tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:00.037062 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e2e1f3b-7177-4c1c-b6ce-19f3404d3dcc tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:00.037499 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e2e1f3b-7177-4c1c-b6ce-19f3404d3dcc tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:00.170894 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9e2e1f3b-7177-4c1c-b6ce-19f3404d3dcc tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:00.179557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9e2e1f3b-7177-4c1c-b6ce-19f3404d3dcc tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:00.181098 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9e2e1f3b-7177-4c1c-b6ce-19f3404d3dcc tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:00.182270 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9e2e1f3b-7177-4c1c-b6ce-19f3404d3dcc tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1746 microversion: 2.20 time: 0.157402 Jul 25 08:52:00.182912 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 365/691] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:00 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:01.207387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-91f89f49-e910-4305-9272-96e843ab82c1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:01.208017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-91f89f49-e910-4305-9272-96e843ab82c1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:01.214719 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-91f89f49-e910-4305-9272-96e843ab82c1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:01.215169 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-91f89f49-e910-4305-9272-96e843ab82c1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:01.215942 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-91f89f49-e910-4305-9272-96e843ab82c1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:01.216375 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-91f89f49-e910-4305-9272-96e843ab82c1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:01.357297 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-91f89f49-e910-4305-9272-96e843ab82c1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:01.365394 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-91f89f49-e910-4305-9272-96e843ab82c1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:01.366896 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-91f89f49-e910-4305-9272-96e843ab82c1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:01.368051 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-91f89f49-e910-4305-9272-96e843ab82c1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1746 microversion: 2.20 time: 0.165129 Jul 25 08:52:01.368931 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 327/692] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:01 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:02.392482 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cb412e7b-4287-4625-be0d-b993debcff72 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:02.393209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cb412e7b-4287-4625-be0d-b993debcff72 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:02.399935 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb412e7b-4287-4625-be0d-b993debcff72 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:02.400383 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb412e7b-4287-4625-be0d-b993debcff72 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:02.401190 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb412e7b-4287-4625-be0d-b993debcff72 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:02.401627 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb412e7b-4287-4625-be0d-b993debcff72 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:02.534276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cb412e7b-4287-4625-be0d-b993debcff72 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:02.542699 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cb412e7b-4287-4625-be0d-b993debcff72 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:02.544188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cb412e7b-4287-4625-be0d-b993debcff72 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:02.545354 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cb412e7b-4287-4625-be0d-b993debcff72 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1746 microversion: 2.20 time: 0.156680 Jul 25 08:52:02.545901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 366/693] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:02 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:03.569734 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-837348ab-ed94-4419-b7bd-c1756f0b2d81 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:03.570328 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-837348ab-ed94-4419-b7bd-c1756f0b2d81 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:03.572672 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=35 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:03.578055 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-837348ab-ed94-4419-b7bd-c1756f0b2d81 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:03.578509 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-837348ab-ed94-4419-b7bd-c1756f0b2d81 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:03.579299 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-837348ab-ed94-4419-b7bd-c1756f0b2d81 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:03.579756 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-837348ab-ed94-4419-b7bd-c1756f0b2d81 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:03.718218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-837348ab-ed94-4419-b7bd-c1756f0b2d81 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:03.727022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-837348ab-ed94-4419-b7bd-c1756f0b2d81 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:03.728565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-837348ab-ed94-4419-b7bd-c1756f0b2d81 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:03.729766 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-837348ab-ed94-4419-b7bd-c1756f0b2d81 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1746 microversion: 2.20 time: 0.164598 Jul 25 08:52:03.730330 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 328/694] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:03 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:04.753691 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-93eccdca-42a1-406a-a761-dd89e5af0968 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:04.754276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-93eccdca-42a1-406a-a761-dd89e5af0968 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:04.762319 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93eccdca-42a1-406a-a761-dd89e5af0968 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:04.763013 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93eccdca-42a1-406a-a761-dd89e5af0968 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:04.763874 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93eccdca-42a1-406a-a761-dd89e5af0968 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:04.764399 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93eccdca-42a1-406a-a761-dd89e5af0968 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:04.796055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:04.926204 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-93eccdca-42a1-406a-a761-dd89e5af0968 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:04.934879 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-93eccdca-42a1-406a-a761-dd89e5af0968 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:04.936365 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-93eccdca-42a1-406a-a761-dd89e5af0968 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:04.937594 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-93eccdca-42a1-406a-a761-dd89e5af0968 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1746 microversion: 2.20 time: 0.187957 Jul 25 08:52:04.938310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 367/695] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:04 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1746 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:05.225132 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-f6e4b0fd-5871-4a5e-8a89-e7f5c971f5e1 req-79dc974f-cd5b-45a1-9380-0c32d1376221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4a347c-82ac-48e1-a31e-45f7eb643cda", "name": "network-vif-plugged", "status": "completed", "tag": "8fcdc018-b6d0-4c78-ac99-e89933f5caf7"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:52:05.235654 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-f6e4b0fd-5871-4a5e-8a89-e7f5c971f5e1 req-79dc974f-cd5b-45a1-9380-0c32d1376221 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:05.236101 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-f6e4b0fd-5871-4a5e-8a89-e7f5c971f5e1 req-79dc974f-cd5b-45a1-9380-0c32d1376221 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:05.248811 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-f6e4b0fd-5871-4a5e-8a89-e7f5c971f5e1 req-79dc974f-cd5b-45a1-9380-0c32d1376221 service nova] Creating event network-vif-plugged:8fcdc018-b6d0-4c78-ac99-e89933f5caf7 for instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda on hv-cinder-85084 Jul 25 08:52:05.254176 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-f6e4b0fd-5871-4a5e-8a89-e7f5c971f5e1 req-79dc974f-cd5b-45a1-9380-0c32d1376221 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104615 Jul 25 08:52:05.254983 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 329/696] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:52:05.961874 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4df46db6-a99f-46c3-8cde-f33e47d3dfdf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:05.963028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4df46db6-a99f-46c3-8cde-f33e47d3dfdf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:05.969817 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4df46db6-a99f-46c3-8cde-f33e47d3dfdf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:05.970260 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4df46db6-a99f-46c3-8cde-f33e47d3dfdf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:05.971029 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4df46db6-a99f-46c3-8cde-f33e47d3dfdf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:05.971454 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4df46db6-a99f-46c3-8cde-f33e47d3dfdf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:06.118356 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4df46db6-a99f-46c3-8cde-f33e47d3dfdf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:06.129123 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4df46db6-a99f-46c3-8cde-f33e47d3dfdf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:06.131358 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4df46db6-a99f-46c3-8cde-f33e47d3dfdf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:06.133414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4df46db6-a99f-46c3-8cde-f33e47d3dfdf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1746 microversion: 2.20 time: 0.175396 Jul 25 08:52:06.134462 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 368/697] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:05 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:07.174591 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-12ad8c9e-1f4d-4dd1-a03c-3d3d9c850727 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:07.175740 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-12ad8c9e-1f4d-4dd1-a03c-3d3d9c850727 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:07.194140 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-12ad8c9e-1f4d-4dd1-a03c-3d3d9c850727 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:07.194604 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-12ad8c9e-1f4d-4dd1-a03c-3d3d9c850727 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:07.198788 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-12ad8c9e-1f4d-4dd1-a03c-3d3d9c850727 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:07.199299 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-12ad8c9e-1f4d-4dd1-a03c-3d3d9c850727 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:07.420428 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-12ad8c9e-1f4d-4dd1-a03c-3d3d9c850727 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:07.441020 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-12ad8c9e-1f4d-4dd1-a03c-3d3d9c850727 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:07.443676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-12ad8c9e-1f4d-4dd1-a03c-3d3d9c850727 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:07.448363 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-12ad8c9e-1f4d-4dd1-a03c-3d3d9c850727 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.288970 Jul 25 08:52:07.465178 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 330/698] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:07 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:08.477908 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1126a6e4-e220-440b-af43-5cb6c49fe480 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:08.478512 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1126a6e4-e220-440b-af43-5cb6c49fe480 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:08.485065 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1126a6e4-e220-440b-af43-5cb6c49fe480 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:08.485513 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1126a6e4-e220-440b-af43-5cb6c49fe480 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:08.486272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1126a6e4-e220-440b-af43-5cb6c49fe480 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:08.486705 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1126a6e4-e220-440b-af43-5cb6c49fe480 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:08.664904 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1126a6e4-e220-440b-af43-5cb6c49fe480 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:08.674366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1126a6e4-e220-440b-af43-5cb6c49fe480 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:08.675875 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1126a6e4-e220-440b-af43-5cb6c49fe480 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:08.677143 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1126a6e4-e220-440b-af43-5cb6c49fe480 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.203749 Jul 25 08:52:08.677884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 369/699] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:08 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:09.701532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a16bd593-d49d-46dc-bb0c-d52e82c86d34 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:09.703026 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a16bd593-d49d-46dc-bb0c-d52e82c86d34 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:09.710357 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a16bd593-d49d-46dc-bb0c-d52e82c86d34 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:09.711501 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a16bd593-d49d-46dc-bb0c-d52e82c86d34 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:09.712759 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a16bd593-d49d-46dc-bb0c-d52e82c86d34 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:09.713366 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a16bd593-d49d-46dc-bb0c-d52e82c86d34 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:09.909639 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a16bd593-d49d-46dc-bb0c-d52e82c86d34 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:09.923027 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a16bd593-d49d-46dc-bb0c-d52e82c86d34 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:09.924648 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a16bd593-d49d-46dc-bb0c-d52e82c86d34 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:09.925841 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a16bd593-d49d-46dc-bb0c-d52e82c86d34 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.228469 Jul 25 08:52:09.926703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 331/700] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:09 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:10.950492 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fa329330-d6e1-420c-b57a-da9ab2b3253a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:10.951526 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fa329330-d6e1-420c-b57a-da9ab2b3253a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:10.955222 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:10.959839 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa329330-d6e1-420c-b57a-da9ab2b3253a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:10.960290 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa329330-d6e1-420c-b57a-da9ab2b3253a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:10.961095 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa329330-d6e1-420c-b57a-da9ab2b3253a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:10.961526 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa329330-d6e1-420c-b57a-da9ab2b3253a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:11.122678 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fa329330-d6e1-420c-b57a-da9ab2b3253a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:11.132686 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fa329330-d6e1-420c-b57a-da9ab2b3253a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:11.134539 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fa329330-d6e1-420c-b57a-da9ab2b3253a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:11.135730 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fa329330-d6e1-420c-b57a-da9ab2b3253a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.189177 Jul 25 08:52:11.136284 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 370/701] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:10 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:12.159345 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-12b38bf5-1ad3-4b68-a786-82683a0ce414 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:12.160026 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-12b38bf5-1ad3-4b68-a786-82683a0ce414 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:12.169713 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-12b38bf5-1ad3-4b68-a786-82683a0ce414 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:12.170404 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-12b38bf5-1ad3-4b68-a786-82683a0ce414 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:12.172015 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-12b38bf5-1ad3-4b68-a786-82683a0ce414 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:12.172993 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-12b38bf5-1ad3-4b68-a786-82683a0ce414 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:12.320808 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-12b38bf5-1ad3-4b68-a786-82683a0ce414 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:12.330158 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-12b38bf5-1ad3-4b68-a786-82683a0ce414 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:12.331964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-12b38bf5-1ad3-4b68-a786-82683a0ce414 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:12.333188 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-12b38bf5-1ad3-4b68-a786-82683a0ce414 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.177808 Jul 25 08:52:12.334563 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 332/702] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:12 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:13.358648 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e51ae39c-1c93-4d62-a544-2d57e93a19ed tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:13.359268 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e51ae39c-1c93-4d62-a544-2d57e93a19ed tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:13.366106 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e51ae39c-1c93-4d62-a544-2d57e93a19ed tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:13.367641 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e51ae39c-1c93-4d62-a544-2d57e93a19ed tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:13.367641 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e51ae39c-1c93-4d62-a544-2d57e93a19ed tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:13.367930 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e51ae39c-1c93-4d62-a544-2d57e93a19ed tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:13.524757 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e51ae39c-1c93-4d62-a544-2d57e93a19ed tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:13.532915 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e51ae39c-1c93-4d62-a544-2d57e93a19ed tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:13.534394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e51ae39c-1c93-4d62-a544-2d57e93a19ed tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:13.535776 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e51ae39c-1c93-4d62-a544-2d57e93a19ed tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.181196 Jul 25 08:52:13.536615 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 371/703] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:13 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:52:14.562774 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-49651511-8f5e-4242-9ad6-ad381b7198d3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:14.564050 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-49651511-8f5e-4242-9ad6-ad381b7198d3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:14.571779 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49651511-8f5e-4242-9ad6-ad381b7198d3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:14.572509 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49651511-8f5e-4242-9ad6-ad381b7198d3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:14.573522 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49651511-8f5e-4242-9ad6-ad381b7198d3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:14.573954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-49651511-8f5e-4242-9ad6-ad381b7198d3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:14.711352 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-49651511-8f5e-4242-9ad6-ad381b7198d3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:14.720896 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-49651511-8f5e-4242-9ad6-ad381b7198d3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:14.722446 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-49651511-8f5e-4242-9ad6-ad381b7198d3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:14.723634 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-49651511-8f5e-4242-9ad6-ad381b7198d3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.164789 Jul 25 08:52:14.724196 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 333/704] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:14 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:15.751476 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ffcb1d53-ca79-43e2-ab6b-979e3f9706ef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:15.752645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ffcb1d53-ca79-43e2-ab6b-979e3f9706ef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:15.764367 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ffcb1d53-ca79-43e2-ab6b-979e3f9706ef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:15.764367 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ffcb1d53-ca79-43e2-ab6b-979e3f9706ef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:15.764367 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ffcb1d53-ca79-43e2-ab6b-979e3f9706ef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:15.764367 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ffcb1d53-ca79-43e2-ab6b-979e3f9706ef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:15.909083 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ffcb1d53-ca79-43e2-ab6b-979e3f9706ef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:15.919735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ffcb1d53-ca79-43e2-ab6b-979e3f9706ef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:15.921630 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ffcb1d53-ca79-43e2-ab6b-979e3f9706ef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:15.923077 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ffcb1d53-ca79-43e2-ab6b-979e3f9706ef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.177324 Jul 25 08:52:15.924028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 372/705] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:15 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:16.948014 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-45411fb7-1556-4936-8395-b5e5c1c5afc8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:16.948651 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-45411fb7-1556-4936-8395-b5e5c1c5afc8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:16.955137 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-45411fb7-1556-4936-8395-b5e5c1c5afc8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:16.955593 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-45411fb7-1556-4936-8395-b5e5c1c5afc8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:16.956347 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-45411fb7-1556-4936-8395-b5e5c1c5afc8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:16.956812 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-45411fb7-1556-4936-8395-b5e5c1c5afc8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:17.098817 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-45411fb7-1556-4936-8395-b5e5c1c5afc8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:17.107493 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-45411fb7-1556-4936-8395-b5e5c1c5afc8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:17.109005 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-45411fb7-1556-4936-8395-b5e5c1c5afc8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:17.110144 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-45411fb7-1556-4936-8395-b5e5c1c5afc8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.167117 Jul 25 08:52:17.110703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 334/706] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:16 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:18.137989 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-53ed3b2b-d1b9-43a3-9723-1eaf0679df3f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:18.139261 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-53ed3b2b-d1b9-43a3-9723-1eaf0679df3f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:18.146848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53ed3b2b-d1b9-43a3-9723-1eaf0679df3f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:18.147295 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53ed3b2b-d1b9-43a3-9723-1eaf0679df3f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:18.148588 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53ed3b2b-d1b9-43a3-9723-1eaf0679df3f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:18.149018 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-53ed3b2b-d1b9-43a3-9723-1eaf0679df3f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:18.291855 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-53ed3b2b-d1b9-43a3-9723-1eaf0679df3f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:18.300914 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-53ed3b2b-d1b9-43a3-9723-1eaf0679df3f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:18.302428 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-53ed3b2b-d1b9-43a3-9723-1eaf0679df3f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:18.303664 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-53ed3b2b-d1b9-43a3-9723-1eaf0679df3f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.169905 Jul 25 08:52:18.304716 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 373/707] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:18 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:19.327759 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-19ac62f1-3c91-4edf-a807-3fdbe0b90d87 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:19.328419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-19ac62f1-3c91-4edf-a807-3fdbe0b90d87 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:19.335784 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-19ac62f1-3c91-4edf-a807-3fdbe0b90d87 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:19.336242 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-19ac62f1-3c91-4edf-a807-3fdbe0b90d87 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:19.337067 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-19ac62f1-3c91-4edf-a807-3fdbe0b90d87 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:19.337508 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-19ac62f1-3c91-4edf-a807-3fdbe0b90d87 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:19.475579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-19ac62f1-3c91-4edf-a807-3fdbe0b90d87 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:19.484268 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-19ac62f1-3c91-4edf-a807-3fdbe0b90d87 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:19.485819 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-19ac62f1-3c91-4edf-a807-3fdbe0b90d87 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:19.486982 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-19ac62f1-3c91-4edf-a807-3fdbe0b90d87 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.163465 Jul 25 08:52:19.487545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 335/708] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:19 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:20.511629 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-853c95cf-3d5f-480c-983e-4371033a83da tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:20.512277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-853c95cf-3d5f-480c-983e-4371033a83da tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:20.519465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-853c95cf-3d5f-480c-983e-4371033a83da tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:20.519465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-853c95cf-3d5f-480c-983e-4371033a83da tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:20.520108 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-853c95cf-3d5f-480c-983e-4371033a83da tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:20.520544 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-853c95cf-3d5f-480c-983e-4371033a83da tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:20.678766 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-853c95cf-3d5f-480c-983e-4371033a83da tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:20.689296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-853c95cf-3d5f-480c-983e-4371033a83da tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:20.691427 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-853c95cf-3d5f-480c-983e-4371033a83da tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:20.695871 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-853c95cf-3d5f-480c-983e-4371033a83da tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.187207 Jul 25 08:52:20.697093 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 374/709] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:20 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:21.721015 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-de959a4f-449d-4dbc-aaf2-f3a795177591 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:21.721697 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-de959a4f-449d-4dbc-aaf2-f3a795177591 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:21.728248 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-de959a4f-449d-4dbc-aaf2-f3a795177591 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:21.728741 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-de959a4f-449d-4dbc-aaf2-f3a795177591 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:21.729506 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-de959a4f-449d-4dbc-aaf2-f3a795177591 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:21.729935 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-de959a4f-449d-4dbc-aaf2-f3a795177591 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:21.857274 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-de959a4f-449d-4dbc-aaf2-f3a795177591 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:21.865126 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-de959a4f-449d-4dbc-aaf2-f3a795177591 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:21.866756 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-de959a4f-449d-4dbc-aaf2-f3a795177591 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:21.867915 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-de959a4f-449d-4dbc-aaf2-f3a795177591 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1741 microversion: 2.20 time: 0.150780 Jul 25 08:52:21.868486 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 336/710] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:21 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:22.891269 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e28f7b6a-cc10-4d3c-ab5e-f4c8da0f95cd tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:22.891884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e28f7b6a-cc10-4d3c-ab5e-f4c8da0f95cd tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:22.898445 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e28f7b6a-cc10-4d3c-ab5e-f4c8da0f95cd tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:22.898903 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e28f7b6a-cc10-4d3c-ab5e-f4c8da0f95cd tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:22.899666 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e28f7b6a-cc10-4d3c-ab5e-f4c8da0f95cd tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:22.900103 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e28f7b6a-cc10-4d3c-ab5e-f4c8da0f95cd tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:23.036228 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e28f7b6a-cc10-4d3c-ab5e-f4c8da0f95cd tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:23.045393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e28f7b6a-cc10-4d3c-ab5e-f4c8da0f95cd tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:23.046890 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e28f7b6a-cc10-4d3c-ab5e-f4c8da0f95cd tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:23.048070 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e28f7b6a-cc10-4d3c-ab5e-f4c8da0f95cd tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1723 microversion: 2.20 time: 0.160640 Jul 25 08:52:23.048645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 375/711] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:22 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:24.071920 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c28057b9-06af-4aa3-955c-3d5a42a203be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:24.073199 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c28057b9-06af-4aa3-955c-3d5a42a203be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:24.079756 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c28057b9-06af-4aa3-955c-3d5a42a203be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:24.080207 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c28057b9-06af-4aa3-955c-3d5a42a203be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:24.081007 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c28057b9-06af-4aa3-955c-3d5a42a203be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:24.081441 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c28057b9-06af-4aa3-955c-3d5a42a203be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:24.217261 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c28057b9-06af-4aa3-955c-3d5a42a203be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:24.225209 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c28057b9-06af-4aa3-955c-3d5a42a203be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:24.226730 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c28057b9-06af-4aa3-955c-3d5a42a203be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:24.227883 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c28057b9-06af-4aa3-955c-3d5a42a203be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1723 microversion: 2.20 time: 0.159836 Jul 25 08:52:24.228450 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 337/712] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:24 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:25.252914 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-831169a4-46e1-491b-8a7a-76cf3f5f2bcf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:25.253785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-831169a4-46e1-491b-8a7a-76cf3f5f2bcf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:25.262031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-831169a4-46e1-491b-8a7a-76cf3f5f2bcf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:25.262515 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-831169a4-46e1-491b-8a7a-76cf3f5f2bcf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:25.263362 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-831169a4-46e1-491b-8a7a-76cf3f5f2bcf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:25.263800 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-831169a4-46e1-491b-8a7a-76cf3f5f2bcf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:25.278372 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-fdde9a20-c0b8-492f-86bd-9ebd19d1ce4e req-97d2aa8c-f05f-46bb-acaf-c2950b734c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4a347c-82ac-48e1-a31e-45f7eb643cda", "name": "network-vif-unplugged", "status": "completed", "tag": "8fcdc018-b6d0-4c78-ac99-e89933f5caf7"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:52:25.298364 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-fdde9a20-c0b8-492f-86bd-9ebd19d1ce4e req-97d2aa8c-f05f-46bb-acaf-c2950b734c6d service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:25.298823 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-fdde9a20-c0b8-492f-86bd-9ebd19d1ce4e req-97d2aa8c-f05f-46bb-acaf-c2950b734c6d service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:25.325842 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-fdde9a20-c0b8-492f-86bd-9ebd19d1ce4e req-97d2aa8c-f05f-46bb-acaf-c2950b734c6d service nova] Creating event network-vif-unplugged:8fcdc018-b6d0-4c78-ac99-e89933f5caf7 for instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda on hv-cinder-85084 Jul 25 08:52:25.334858 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-fdde9a20-c0b8-492f-86bd-9ebd19d1ce4e req-97d2aa8c-f05f-46bb-acaf-c2950b734c6d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061124 Jul 25 08:52:25.335542 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 338/713] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:52:25.423011 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-831169a4-46e1-491b-8a7a-76cf3f5f2bcf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:25.434388 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-831169a4-46e1-491b-8a7a-76cf3f5f2bcf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:25.437051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-831169a4-46e1-491b-8a7a-76cf3f5f2bcf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:25.438243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-831169a4-46e1-491b-8a7a-76cf3f5f2bcf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1723 microversion: 2.20 time: 0.190136 Jul 25 08:52:25.438800 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 376/714] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:25 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:26.463399 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bc14eb39-2ee7-46cb-b8f9-4cd7aab9df8c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:26.464656 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bc14eb39-2ee7-46cb-b8f9-4cd7aab9df8c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:26.472088 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc14eb39-2ee7-46cb-b8f9-4cd7aab9df8c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:26.472535 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc14eb39-2ee7-46cb-b8f9-4cd7aab9df8c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:26.473516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc14eb39-2ee7-46cb-b8f9-4cd7aab9df8c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:26.474346 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc14eb39-2ee7-46cb-b8f9-4cd7aab9df8c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:26.675852 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bc14eb39-2ee7-46cb-b8f9-4cd7aab9df8c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:26.686133 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bc14eb39-2ee7-46cb-b8f9-4cd7aab9df8c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:26.687748 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bc14eb39-2ee7-46cb-b8f9-4cd7aab9df8c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:26.689046 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bc14eb39-2ee7-46cb-b8f9-4cd7aab9df8c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1666 microversion: 2.20 time: 0.230355 Jul 25 08:52:26.689805 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 339/715] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:26 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1666 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:26.719202 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-15eb786c-ce0b-4c90-948e-f306a32d9d18 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b92dc107-841b-497f-8900-2864ca624b25"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:52:26.721777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-15eb786c-ce0b-4c90-948e-f306a32d9d18 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:26.728766 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15eb786c-ce0b-4c90-948e-f306a32d9d18 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:26.729337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15eb786c-ce0b-4c90-948e-f306a32d9d18 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:26.730908 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15eb786c-ce0b-4c90-948e-f306a32d9d18 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:26.731357 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15eb786c-ce0b-4c90-948e-f306a32d9d18 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:27.061176 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-15eb786c-ce0b-4c90-948e-f306a32d9d18 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "POST /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.346538 Jul 25 08:52:27.061790 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 377/716] 10.222.0.52 () {62 vars in 1364 bytes} [Mon Jul 25 08:52:26 2022] POST /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments => generated 188 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:52:27.205216 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c17595b0-355b-4e4a-b689-8101e551a2a9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:52:27.206131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c17595b0-355b-4e4a-b689-8101e551a2a9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:27.213976 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c17595b0-355b-4e4a-b689-8101e551a2a9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:27.214528 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c17595b0-355b-4e4a-b689-8101e551a2a9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:27.215321 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c17595b0-355b-4e4a-b689-8101e551a2a9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:27.215761 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c17595b0-355b-4e4a-b689-8101e551a2a9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:27.318681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c17595b0-355b-4e4a-b689-8101e551a2a9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "POST /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/action" status: 202 len: 0 microversion: 2.20 time: 0.120459 Jul 25 08:52:27.319476 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 340/717] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Jul 25 08:52:27 2022] POST /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:52:27.329155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7d72ca9d-8322-42f1-96d4-68e78fa4d012 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:27.330134 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7d72ca9d-8322-42f1-96d4-68e78fa4d012 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:27.336943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d72ca9d-8322-42f1-96d4-68e78fa4d012 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:27.337392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d72ca9d-8322-42f1-96d4-68e78fa4d012 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:27.338717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d72ca9d-8322-42f1-96d4-68e78fa4d012 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:27.340262 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d72ca9d-8322-42f1-96d4-68e78fa4d012 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:27.520129 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7d72ca9d-8322-42f1-96d4-68e78fa4d012 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:27.534608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7d72ca9d-8322-42f1-96d4-68e78fa4d012 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:27.536126 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7d72ca9d-8322-42f1-96d4-68e78fa4d012 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:27.537342 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7d72ca9d-8322-42f1-96d4-68e78fa4d012 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1752 microversion: 2.20 time: 0.212146 Jul 25 08:52:27.537909 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 378/718] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:27 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1752 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:52:28.562081 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-091bba3d-a9f7-4245-8f01-3375f350e359 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:28.562703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-091bba3d-a9f7-4245-8f01-3375f350e359 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:28.569727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-091bba3d-a9f7-4245-8f01-3375f350e359 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:28.570178 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-091bba3d-a9f7-4245-8f01-3375f350e359 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:28.570953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-091bba3d-a9f7-4245-8f01-3375f350e359 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:28.571392 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-091bba3d-a9f7-4245-8f01-3375f350e359 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:28.723567 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-091bba3d-a9f7-4245-8f01-3375f350e359 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:28.735532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-091bba3d-a9f7-4245-8f01-3375f350e359 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:28.737007 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-091bba3d-a9f7-4245-8f01-3375f350e359 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:28.738165 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-091bba3d-a9f7-4245-8f01-3375f350e359 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1752 microversion: 2.20 time: 0.181526 Jul 25 08:52:28.738720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 341/719] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:28 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:29.762908 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-540a6854-f6fd-4eab-93cd-632165614771 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:29.763533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-540a6854-f6fd-4eab-93cd-632165614771 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:29.770104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-540a6854-f6fd-4eab-93cd-632165614771 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:29.770553 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-540a6854-f6fd-4eab-93cd-632165614771 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:29.771313 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-540a6854-f6fd-4eab-93cd-632165614771 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:29.771748 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-540a6854-f6fd-4eab-93cd-632165614771 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:29.903931 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-540a6854-f6fd-4eab-93cd-632165614771 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:29.913439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-540a6854-f6fd-4eab-93cd-632165614771 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:29.915075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-540a6854-f6fd-4eab-93cd-632165614771 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:29.916369 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-540a6854-f6fd-4eab-93cd-632165614771 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1754 microversion: 2.20 time: 0.157545 Jul 25 08:52:29.917042 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 379/720] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:29 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:52:30.941402 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2cfce240-b9b7-45d9-b445-32a5f49300db tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:30.942244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2cfce240-b9b7-45d9-b445-32a5f49300db tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:30.950370 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2cfce240-b9b7-45d9-b445-32a5f49300db tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:30.950827 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2cfce240-b9b7-45d9-b445-32a5f49300db tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:30.951608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2cfce240-b9b7-45d9-b445-32a5f49300db tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:30.952046 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2cfce240-b9b7-45d9-b445-32a5f49300db tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:30.956646 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:31.100093 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2cfce240-b9b7-45d9-b445-32a5f49300db tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:31.109489 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2cfce240-b9b7-45d9-b445-32a5f49300db tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:31.111003 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2cfce240-b9b7-45d9-b445-32a5f49300db tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:31.112176 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2cfce240-b9b7-45d9-b445-32a5f49300db tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.175051 Jul 25 08:52:31.112765 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 342/721] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:30 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:32.140216 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-761bc30a-cbc1-4c32-b426-f987c8531ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:32.140874 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-761bc30a-cbc1-4c32-b426-f987c8531ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:32.148269 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-761bc30a-cbc1-4c32-b426-f987c8531ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:32.148751 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-761bc30a-cbc1-4c32-b426-f987c8531ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:32.149520 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-761bc30a-cbc1-4c32-b426-f987c8531ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:32.149952 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-761bc30a-cbc1-4c32-b426-f987c8531ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:32.281929 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-761bc30a-cbc1-4c32-b426-f987c8531ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:32.292389 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-761bc30a-cbc1-4c32-b426-f987c8531ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:32.294250 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-761bc30a-cbc1-4c32-b426-f987c8531ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:32.296106 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-761bc30a-cbc1-4c32-b426-f987c8531ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.159236 Jul 25 08:52:32.296328 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 380/722] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:32 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:52:33.319135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d3ffde9f-e80b-42ca-8be4-01766a32f515 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:33.319745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d3ffde9f-e80b-42ca-8be4-01766a32f515 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:33.326193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d3ffde9f-e80b-42ca-8be4-01766a32f515 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:33.326643 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d3ffde9f-e80b-42ca-8be4-01766a32f515 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:33.327402 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d3ffde9f-e80b-42ca-8be4-01766a32f515 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:33.327865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d3ffde9f-e80b-42ca-8be4-01766a32f515 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:33.455769 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d3ffde9f-e80b-42ca-8be4-01766a32f515 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:33.465381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d3ffde9f-e80b-42ca-8be4-01766a32f515 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:33.466883 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d3ffde9f-e80b-42ca-8be4-01766a32f515 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:33.468012 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d3ffde9f-e80b-42ca-8be4-01766a32f515 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.152784 Jul 25 08:52:33.468565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 343/723] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:33 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:34.493499 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4f62908f-ad3b-4d2a-b116-e3d59f967e9d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:34.494870 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4f62908f-ad3b-4d2a-b116-e3d59f967e9d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:34.501716 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4f62908f-ad3b-4d2a-b116-e3d59f967e9d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:34.502166 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4f62908f-ad3b-4d2a-b116-e3d59f967e9d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:34.502942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4f62908f-ad3b-4d2a-b116-e3d59f967e9d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:34.503376 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4f62908f-ad3b-4d2a-b116-e3d59f967e9d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:34.518433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:34.635251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4f62908f-ad3b-4d2a-b116-e3d59f967e9d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:34.643675 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4f62908f-ad3b-4d2a-b116-e3d59f967e9d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:34.645232 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4f62908f-ad3b-4d2a-b116-e3d59f967e9d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:34.646372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4f62908f-ad3b-4d2a-b116-e3d59f967e9d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.156810 Jul 25 08:52:34.646921 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 381/724] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:34 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:35.669637 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a75fcd11-1571-4161-8aef-71087fa7199c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:35.670243 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a75fcd11-1571-4161-8aef-71087fa7199c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:35.672087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=34 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:35.677427 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a75fcd11-1571-4161-8aef-71087fa7199c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:35.677876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a75fcd11-1571-4161-8aef-71087fa7199c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:35.678630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a75fcd11-1571-4161-8aef-71087fa7199c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:35.679164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a75fcd11-1571-4161-8aef-71087fa7199c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:35.827452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a75fcd11-1571-4161-8aef-71087fa7199c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:35.848186 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a75fcd11-1571-4161-8aef-71087fa7199c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:35.849733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a75fcd11-1571-4161-8aef-71087fa7199c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:35.856697 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a75fcd11-1571-4161-8aef-71087fa7199c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.185515 Jul 25 08:52:35.857482 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 344/725] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:35 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:36.754690 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-476d6bae-3121-4294-bbb5-7e2bb0b6f6fa tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:36.755173 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-476d6bae-3121-4294-bbb5-7e2bb0b6f6fa tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:36.761956 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-476d6bae-3121-4294-bbb5-7e2bb0b6f6fa tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:36.762398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-476d6bae-3121-4294-bbb5-7e2bb0b6f6fa tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:36.763149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-476d6bae-3121-4294-bbb5-7e2bb0b6f6fa tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:36.763575 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-476d6bae-3121-4294-bbb5-7e2bb0b6f6fa tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:36.873498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-476d6bae-3121-4294-bbb5-7e2bb0b6f6fa tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lazy-loading 'services' on Instance uuid c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:52:36.884064 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0e233a65-80f4-45c0-aa5f-ae0de6b4de8d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:36.885535 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0e233a65-80f4-45c0-aa5f-ae0de6b4de8d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:36.894627 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0e233a65-80f4-45c0-aa5f-ae0de6b4de8d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:36.896230 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0e233a65-80f4-45c0-aa5f-ae0de6b4de8d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:36.897602 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0e233a65-80f4-45c0-aa5f-ae0de6b4de8d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:36.898275 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0e233a65-80f4-45c0-aa5f-ae0de6b4de8d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:36.964836 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-476d6bae-3121-4294-bbb5-7e2bb0b6f6fa tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/os-volume_attachments/ace2a96f-3a2d-4c5c-b7d2-0813f8368009" status: 202 len: 0 microversion: 2.1 time: 0.315593 Jul 25 08:52:36.965991 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 382/726] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:52:36 2022] DELETE /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/os-volume_attachments/ace2a96f-3a2d-4c5c-b7d2-0813f8368009 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:52:37.046238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0e233a65-80f4-45c0-aa5f-ae0de6b4de8d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:37.055047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0e233a65-80f4-45c0-aa5f-ae0de6b4de8d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:37.056617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0e233a65-80f4-45c0-aa5f-ae0de6b4de8d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:37.057830 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0e233a65-80f4-45c0-aa5f-ae0de6b4de8d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.179453 Jul 25 08:52:37.058395 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 345/727] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:36 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:52:38.084634 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-01cc17cc-1af1-4e95-bc9d-b656f6f011f4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:38.085332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-01cc17cc-1af1-4e95-bc9d-b656f6f011f4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:38.091523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-01cc17cc-1af1-4e95-bc9d-b656f6f011f4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:38.091967 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-01cc17cc-1af1-4e95-bc9d-b656f6f011f4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:38.092750 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-01cc17cc-1af1-4e95-bc9d-b656f6f011f4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:38.093181 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-01cc17cc-1af1-4e95-bc9d-b656f6f011f4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:38.254697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-01cc17cc-1af1-4e95-bc9d-b656f6f011f4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:38.265512 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-01cc17cc-1af1-4e95-bc9d-b656f6f011f4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:38.267483 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-01cc17cc-1af1-4e95-bc9d-b656f6f011f4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:38.269042 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-01cc17cc-1af1-4e95-bc9d-b656f6f011f4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.189076 Jul 25 08:52:38.269600 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 383/728] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:38 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:39.293155 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5f8ef767-763a-4225-8898-99b38e053598 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:39.293760 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5f8ef767-763a-4225-8898-99b38e053598 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:39.301100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5f8ef767-763a-4225-8898-99b38e053598 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:39.301789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5f8ef767-763a-4225-8898-99b38e053598 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:39.302729 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5f8ef767-763a-4225-8898-99b38e053598 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:39.303305 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5f8ef767-763a-4225-8898-99b38e053598 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:39.433307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5f8ef767-763a-4225-8898-99b38e053598 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:39.441726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5f8ef767-763a-4225-8898-99b38e053598 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:39.443207 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5f8ef767-763a-4225-8898-99b38e053598 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:39.444355 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5f8ef767-763a-4225-8898-99b38e053598 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.155633 Jul 25 08:52:39.444949 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 346/729] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:39 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:40.471517 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b2d6e671-c7f6-4e92-b907-b8860964a492 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:40.472516 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b2d6e671-c7f6-4e92-b907-b8860964a492 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:40.483634 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b2d6e671-c7f6-4e92-b907-b8860964a492 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:40.484355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b2d6e671-c7f6-4e92-b907-b8860964a492 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:40.485623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b2d6e671-c7f6-4e92-b907-b8860964a492 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:40.486604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b2d6e671-c7f6-4e92-b907-b8860964a492 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:40.648223 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b2d6e671-c7f6-4e92-b907-b8860964a492 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:40.662562 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b2d6e671-c7f6-4e92-b907-b8860964a492 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:40.665158 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b2d6e671-c7f6-4e92-b907-b8860964a492 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:40.667571 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b2d6e671-c7f6-4e92-b907-b8860964a492 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.202479 Jul 25 08:52:40.668491 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 384/730] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:40 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:41.710238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-cc0b207d-7d05-4b69-80b6-542974b1739f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:41.711153 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-cc0b207d-7d05-4b69-80b6-542974b1739f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:41.734541 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cc0b207d-7d05-4b69-80b6-542974b1739f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:41.734997 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cc0b207d-7d05-4b69-80b6-542974b1739f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:41.735786 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cc0b207d-7d05-4b69-80b6-542974b1739f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:41.736224 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cc0b207d-7d05-4b69-80b6-542974b1739f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:41.885504 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-cc0b207d-7d05-4b69-80b6-542974b1739f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:41.894625 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-cc0b207d-7d05-4b69-80b6-542974b1739f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:41.896117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-cc0b207d-7d05-4b69-80b6-542974b1739f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:41.897333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-cc0b207d-7d05-4b69-80b6-542974b1739f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.191480 Jul 25 08:52:41.897899 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 347/731] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:41 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:42.921945 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b92ae28b-77f1-42a9-a23e-c56f3305ad7e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:42.923394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b92ae28b-77f1-42a9-a23e-c56f3305ad7e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:42.931548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=30 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:42.934858 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b92ae28b-77f1-42a9-a23e-c56f3305ad7e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:42.935635 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b92ae28b-77f1-42a9-a23e-c56f3305ad7e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:42.937040 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b92ae28b-77f1-42a9-a23e-c56f3305ad7e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:42.937757 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b92ae28b-77f1-42a9-a23e-c56f3305ad7e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:43.089909 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b92ae28b-77f1-42a9-a23e-c56f3305ad7e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:43.098307 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b92ae28b-77f1-42a9-a23e-c56f3305ad7e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:43.099818 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b92ae28b-77f1-42a9-a23e-c56f3305ad7e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:43.101008 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b92ae28b-77f1-42a9-a23e-c56f3305ad7e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.183403 Jul 25 08:52:43.101563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 385/732] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:42 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:52:44.125682 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4b9490c3-3c00-43ae-86e8-0a970130aca1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:44.126408 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4b9490c3-3c00-43ae-86e8-0a970130aca1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:44.133000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4b9490c3-3c00-43ae-86e8-0a970130aca1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:44.133461 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4b9490c3-3c00-43ae-86e8-0a970130aca1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:44.134770 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4b9490c3-3c00-43ae-86e8-0a970130aca1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:44.135507 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4b9490c3-3c00-43ae-86e8-0a970130aca1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:44.275094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4b9490c3-3c00-43ae-86e8-0a970130aca1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:44.283808 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4b9490c3-3c00-43ae-86e8-0a970130aca1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:44.285348 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4b9490c3-3c00-43ae-86e8-0a970130aca1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:44.286538 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4b9490c3-3c00-43ae-86e8-0a970130aca1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.164915 Jul 25 08:52:44.287296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 348/733] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:44 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:45.310841 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-14eb7107-0f90-4b78-8497-0a0e68f91efe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:45.311479 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-14eb7107-0f90-4b78-8497-0a0e68f91efe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:45.318203 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-14eb7107-0f90-4b78-8497-0a0e68f91efe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:45.318652 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-14eb7107-0f90-4b78-8497-0a0e68f91efe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:45.319420 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-14eb7107-0f90-4b78-8497-0a0e68f91efe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:45.319848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-14eb7107-0f90-4b78-8497-0a0e68f91efe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:45.466669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-14eb7107-0f90-4b78-8497-0a0e68f91efe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:45.475787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-14eb7107-0f90-4b78-8497-0a0e68f91efe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:45.477375 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-14eb7107-0f90-4b78-8497-0a0e68f91efe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:45.479128 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-14eb7107-0f90-4b78-8497-0a0e68f91efe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.172296 Jul 25 08:52:45.479835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 386/734] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:45 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:46.502969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e12de90a-2de9-461c-9a42-b0e1ba90b659 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:46.504588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e12de90a-2de9-461c-9a42-b0e1ba90b659 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:46.514162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e12de90a-2de9-461c-9a42-b0e1ba90b659 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:46.515007 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e12de90a-2de9-461c-9a42-b0e1ba90b659 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:46.516019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e12de90a-2de9-461c-9a42-b0e1ba90b659 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:46.516714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e12de90a-2de9-461c-9a42-b0e1ba90b659 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:46.655872 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e12de90a-2de9-461c-9a42-b0e1ba90b659 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:46.664812 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e12de90a-2de9-461c-9a42-b0e1ba90b659 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:46.666846 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e12de90a-2de9-461c-9a42-b0e1ba90b659 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:46.668003 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e12de90a-2de9-461c-9a42-b0e1ba90b659 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.169672 Jul 25 08:52:46.668557 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 349/735] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:46 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:47.691099 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-57be5561-17b4-4393-91c0-78c758ad892f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:47.691729 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-57be5561-17b4-4393-91c0-78c758ad892f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:47.698547 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-57be5561-17b4-4393-91c0-78c758ad892f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:47.699001 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-57be5561-17b4-4393-91c0-78c758ad892f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:47.699768 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-57be5561-17b4-4393-91c0-78c758ad892f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:47.700328 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-57be5561-17b4-4393-91c0-78c758ad892f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:47.832383 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-57be5561-17b4-4393-91c0-78c758ad892f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:47.841988 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-57be5561-17b4-4393-91c0-78c758ad892f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:47.843494 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-57be5561-17b4-4393-91c0-78c758ad892f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:47.844681 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-57be5561-17b4-4393-91c0-78c758ad892f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.157369 Jul 25 08:52:47.845254 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 387/736] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:47 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:48.869513 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-24e6ea25-3c11-4fa2-a98a-29a5d17b424d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:48.870094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-24e6ea25-3c11-4fa2-a98a-29a5d17b424d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:48.877151 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-24e6ea25-3c11-4fa2-a98a-29a5d17b424d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:48.877604 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-24e6ea25-3c11-4fa2-a98a-29a5d17b424d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:48.878395 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-24e6ea25-3c11-4fa2-a98a-29a5d17b424d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:48.878829 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-24e6ea25-3c11-4fa2-a98a-29a5d17b424d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:49.007429 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-24e6ea25-3c11-4fa2-a98a-29a5d17b424d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:49.015773 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-24e6ea25-3c11-4fa2-a98a-29a5d17b424d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:49.017320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-24e6ea25-3c11-4fa2-a98a-29a5d17b424d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:49.018474 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-24e6ea25-3c11-4fa2-a98a-29a5d17b424d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.153561 Jul 25 08:52:49.019040 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 350/737] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:48 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:50.041761 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c92ba9bd-c2e9-4f31-9b59-178f0287333d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:50.042389 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c92ba9bd-c2e9-4f31-9b59-178f0287333d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:50.048879 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c92ba9bd-c2e9-4f31-9b59-178f0287333d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:50.049330 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c92ba9bd-c2e9-4f31-9b59-178f0287333d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:50.050093 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c92ba9bd-c2e9-4f31-9b59-178f0287333d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:50.050530 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c92ba9bd-c2e9-4f31-9b59-178f0287333d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:50.198526 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c92ba9bd-c2e9-4f31-9b59-178f0287333d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:50.207562 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c92ba9bd-c2e9-4f31-9b59-178f0287333d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:50.209940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c92ba9bd-c2e9-4f31-9b59-178f0287333d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:50.211505 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c92ba9bd-c2e9-4f31-9b59-178f0287333d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.173499 Jul 25 08:52:50.212660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 388/738] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:50 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:51.235447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f7581517-3f38-482d-951a-32f26ae4e3e7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:51.236054 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f7581517-3f38-482d-951a-32f26ae4e3e7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:51.242607 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f7581517-3f38-482d-951a-32f26ae4e3e7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:51.243052 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f7581517-3f38-482d-951a-32f26ae4e3e7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:51.243879 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f7581517-3f38-482d-951a-32f26ae4e3e7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:51.244306 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f7581517-3f38-482d-951a-32f26ae4e3e7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:51.394483 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f7581517-3f38-482d-951a-32f26ae4e3e7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:51.404590 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f7581517-3f38-482d-951a-32f26ae4e3e7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:51.406194 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f7581517-3f38-482d-951a-32f26ae4e3e7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:51.407943 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f7581517-3f38-482d-951a-32f26ae4e3e7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.176283 Jul 25 08:52:51.408778 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 351/739] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:51 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:52.431834 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d955da51-d469-4310-b871-ab7fcd92da25 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:52.432433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d955da51-d469-4310-b871-ab7fcd92da25 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:52.438990 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d955da51-d469-4310-b871-ab7fcd92da25 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:52.439435 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d955da51-d469-4310-b871-ab7fcd92da25 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:52.440194 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d955da51-d469-4310-b871-ab7fcd92da25 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:52.440704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d955da51-d469-4310-b871-ab7fcd92da25 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:52.571546 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d955da51-d469-4310-b871-ab7fcd92da25 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:52.579811 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d955da51-d469-4310-b871-ab7fcd92da25 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:52.581363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d955da51-d469-4310-b871-ab7fcd92da25 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:52.582558 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d955da51-d469-4310-b871-ab7fcd92da25 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.155145 Jul 25 08:52:52.583113 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 389/740] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:52 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:53.605576 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-89e5d125-b752-4199-a0c7-71500a1b249a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:53.606149 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-89e5d125-b752-4199-a0c7-71500a1b249a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:53.612628 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89e5d125-b752-4199-a0c7-71500a1b249a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:53.613080 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89e5d125-b752-4199-a0c7-71500a1b249a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:53.613835 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89e5d125-b752-4199-a0c7-71500a1b249a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:53.614269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89e5d125-b752-4199-a0c7-71500a1b249a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:53.740841 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-89e5d125-b752-4199-a0c7-71500a1b249a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:53.749686 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-89e5d125-b752-4199-a0c7-71500a1b249a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:53.751449 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-89e5d125-b752-4199-a0c7-71500a1b249a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:53.752608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-89e5d125-b752-4199-a0c7-71500a1b249a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.151017 Jul 25 08:52:53.753170 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 352/741] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:53 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:54.776736 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-023707e6-ad7d-42fc-ad9c-da0d6839602c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:54.777338 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-023707e6-ad7d-42fc-ad9c-da0d6839602c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:54.783729 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-023707e6-ad7d-42fc-ad9c-da0d6839602c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:54.784174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-023707e6-ad7d-42fc-ad9c-da0d6839602c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:54.784951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-023707e6-ad7d-42fc-ad9c-da0d6839602c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:54.785383 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-023707e6-ad7d-42fc-ad9c-da0d6839602c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:54.912619 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-023707e6-ad7d-42fc-ad9c-da0d6839602c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:54.921065 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-023707e6-ad7d-42fc-ad9c-da0d6839602c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:54.922548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-023707e6-ad7d-42fc-ad9c-da0d6839602c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:54.923685 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-023707e6-ad7d-42fc-ad9c-da0d6839602c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.150821 Jul 25 08:52:54.924240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 390/742] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:54 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:55.946930 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4990d656-831e-44a2-89aa-a83db1434743 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:55.947540 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4990d656-831e-44a2-89aa-a83db1434743 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:55.954056 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4990d656-831e-44a2-89aa-a83db1434743 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:55.954507 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4990d656-831e-44a2-89aa-a83db1434743 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:55.955264 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4990d656-831e-44a2-89aa-a83db1434743 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:55.955694 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4990d656-831e-44a2-89aa-a83db1434743 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:56.085739 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4990d656-831e-44a2-89aa-a83db1434743 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:56.094647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4990d656-831e-44a2-89aa-a83db1434743 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:56.096141 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4990d656-831e-44a2-89aa-a83db1434743 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:56.097313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4990d656-831e-44a2-89aa-a83db1434743 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.154389 Jul 25 08:52:56.097881 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 353/743] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:55 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:57.121611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b5802cc4-0548-46f7-aa7f-eaf76e15ee29 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:57.122237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b5802cc4-0548-46f7-aa7f-eaf76e15ee29 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:57.129043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5802cc4-0548-46f7-aa7f-eaf76e15ee29 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:57.129492 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5802cc4-0548-46f7-aa7f-eaf76e15ee29 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:57.130257 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5802cc4-0548-46f7-aa7f-eaf76e15ee29 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:57.130688 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5802cc4-0548-46f7-aa7f-eaf76e15ee29 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:57.206175 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4f885cb8-aea7-43b1-991e-6436dffa9c68 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:52:57.208661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4f885cb8-aea7-43b1-991e-6436dffa9c68 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:57.215734 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f885cb8-aea7-43b1-991e-6436dffa9c68 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:57.216317 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f885cb8-aea7-43b1-991e-6436dffa9c68 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:57.217430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f885cb8-aea7-43b1-991e-6436dffa9c68 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:57.217868 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f885cb8-aea7-43b1-991e-6436dffa9c68 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:57.269554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b5802cc4-0548-46f7-aa7f-eaf76e15ee29 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:57.278953 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b5802cc4-0548-46f7-aa7f-eaf76e15ee29 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:57.280474 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b5802cc4-0548-46f7-aa7f-eaf76e15ee29 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:57.282101 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b5802cc4-0548-46f7-aa7f-eaf76e15ee29 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.164779 Jul 25 08:52:57.282696 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 391/744] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:57 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:57.305032 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4f885cb8-aea7-43b1-991e-6436dffa9c68 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "POST /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/action" status: 202 len: 0 microversion: 2.1 time: 0.100164 Jul 25 08:52:57.305032 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 354/745] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:52:57 2022] POST /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 08:52:57.312549 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bf7b0e06-4d5c-4a05-b200-01c45d53c317 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:57.313188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bf7b0e06-4d5c-4a05-b200-01c45d53c317 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:57.319281 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf7b0e06-4d5c-4a05-b200-01c45d53c317 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:57.319758 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf7b0e06-4d5c-4a05-b200-01c45d53c317 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:57.320525 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf7b0e06-4d5c-4a05-b200-01c45d53c317 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:57.320992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf7b0e06-4d5c-4a05-b200-01c45d53c317 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:57.465543 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bf7b0e06-4d5c-4a05-b200-01c45d53c317 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:57.473430 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bf7b0e06-4d5c-4a05-b200-01c45d53c317 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1753 microversion: 2.1 time: 0.164753 Jul 25 08:52:57.474151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 392/746] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:52:57 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:52:58.311266 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8e44213f-1ca0-46da-b9a3-ab9f33a0a7b7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:58.311954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-8e44213f-1ca0-46da-b9a3-ab9f33a0a7b7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:58.318795 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8e44213f-1ca0-46da-b9a3-ab9f33a0a7b7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:58.319304 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8e44213f-1ca0-46da-b9a3-ab9f33a0a7b7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:58.320154 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8e44213f-1ca0-46da-b9a3-ab9f33a0a7b7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:58.320677 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8e44213f-1ca0-46da-b9a3-ab9f33a0a7b7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:58.451621 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8e44213f-1ca0-46da-b9a3-ab9f33a0a7b7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:58.460116 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8e44213f-1ca0-46da-b9a3-ab9f33a0a7b7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:58.461642 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8e44213f-1ca0-46da-b9a3-ab9f33a0a7b7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:58.462905 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8e44213f-1ca0-46da-b9a3-ab9f33a0a7b7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.155781 Jul 25 08:52:58.463344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 355/747] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:58 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:52:58.496744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2d8868bf-271e-470d-bfc4-fa0e8d86b328 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:58.497357 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2d8868bf-271e-470d-bfc4-fa0e8d86b328 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:58.504816 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2d8868bf-271e-470d-bfc4-fa0e8d86b328 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:58.505269 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2d8868bf-271e-470d-bfc4-fa0e8d86b328 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:58.506036 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2d8868bf-271e-470d-bfc4-fa0e8d86b328 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:58.506473 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2d8868bf-271e-470d-bfc4-fa0e8d86b328 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:58.656323 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2d8868bf-271e-470d-bfc4-fa0e8d86b328 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:58.674834 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2d8868bf-271e-470d-bfc4-fa0e8d86b328 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1753 microversion: 2.1 time: 0.181871 Jul 25 08:52:58.675422 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 393/748] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:52:58 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:52:58.987198 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-abdc15d1-fb41-4ee4-bce7-705d852a918a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7b7aba6-924b-445f-a60c-53b02ca7e4f4"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:52:58.990293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-abdc15d1-fb41-4ee4-bce7-705d852a918a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:58.997453 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-abdc15d1-fb41-4ee4-bce7-705d852a918a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:58.997902 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-abdc15d1-fb41-4ee4-bce7-705d852a918a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:58.998926 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-abdc15d1-fb41-4ee4-bce7-705d852a918a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:58.999389 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-abdc15d1-fb41-4ee4-bce7-705d852a918a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:59.281667 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:59.308343 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-abdc15d1-fb41-4ee4-bce7-705d852a918a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.566106 Jul 25 08:52:59.309071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 356/749] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:52:58 2022] POST /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:52:59.410582 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-846f9852-3e88-4bf0-bc89-52b3287a66dc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:52:59.418116 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-846f9852-3e88-4bf0-bc89-52b3287a66dc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:59.418696 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-846f9852-3e88-4bf0-bc89-52b3287a66dc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:59.485280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-846f9852-3e88-4bf0-bc89-52b3287a66dc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Going to try to stop instance {{(pid=124235) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 08:52:59.487676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-83462cfb-59ca-416f-8bc0-2f213d2c265e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:59.488582 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-83462cfb-59ca-416f-8bc0-2f213d2c265e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:59.495708 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-83462cfb-59ca-416f-8bc0-2f213d2c265e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:59.496249 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-83462cfb-59ca-416f-8bc0-2f213d2c265e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:59.497150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-83462cfb-59ca-416f-8bc0-2f213d2c265e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:59.497664 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-83462cfb-59ca-416f-8bc0-2f213d2c265e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:59.539376 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-846f9852-3e88-4bf0-bc89-52b3287a66dc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/action" status: 202 len: 0 microversion: 2.1 time: 0.132649 Jul 25 08:52:59.542679 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 394/750] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:52:59 2022] POST /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:52:59.549263 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b6f1da76-803e-4d31-80db-d3e85eb5e17f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:59.550079 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b6f1da76-803e-4d31-80db-d3e85eb5e17f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:59.556542 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b6f1da76-803e-4d31-80db-d3e85eb5e17f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:59.557035 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b6f1da76-803e-4d31-80db-d3e85eb5e17f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:59.558425 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b6f1da76-803e-4d31-80db-d3e85eb5e17f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:59.558865 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b6f1da76-803e-4d31-80db-d3e85eb5e17f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:59.675210 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-83462cfb-59ca-416f-8bc0-2f213d2c265e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:59.684456 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-83462cfb-59ca-416f-8bc0-2f213d2c265e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:59.685965 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-83462cfb-59ca-416f-8bc0-2f213d2c265e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:59.687116 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-83462cfb-59ca-416f-8bc0-2f213d2c265e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.204332 Jul 25 08:52:59.701102 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 357/751] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:52:59 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:52:59.707104 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-347916ba-c76b-43a5-81a8-9c20afd784ec tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:52:59.707839 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-347916ba-c76b-43a5-81a8-9c20afd784ec tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:52:59.714674 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-347916ba-c76b-43a5-81a8-9c20afd784ec tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:59.715124 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-347916ba-c76b-43a5-81a8-9c20afd784ec tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:59.715891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-347916ba-c76b-43a5-81a8-9c20afd784ec tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:52:59.716320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-347916ba-c76b-43a5-81a8-9c20afd784ec tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:52:59.741507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b6f1da76-803e-4d31-80db-d3e85eb5e17f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:59.749291 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b6f1da76-803e-4d31-80db-d3e85eb5e17f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1680 microversion: 2.1 time: 0.204385 Jul 25 08:52:59.750118 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 395/752] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:52:59 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:52:59.867047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-347916ba-c76b-43a5-81a8-9c20afd784ec tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:52:59.875424 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-347916ba-c76b-43a5-81a8-9c20afd784ec tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.173186 Jul 25 08:52:59.875984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 358/753] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:52:59 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:00.713659 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-04b8ce0a-df9f-42b2-85b3-b09dcf064452 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:00.714279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-04b8ce0a-df9f-42b2-85b3-b09dcf064452 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:00.720822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-04b8ce0a-df9f-42b2-85b3-b09dcf064452 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:00.721277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-04b8ce0a-df9f-42b2-85b3-b09dcf064452 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:00.722051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-04b8ce0a-df9f-42b2-85b3-b09dcf064452 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:00.722486 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-04b8ce0a-df9f-42b2-85b3-b09dcf064452 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:00.737978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:00.771254 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-71154c9a-0930-443e-83a7-05cd336d6598 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:00.771860 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-71154c9a-0930-443e-83a7-05cd336d6598 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:00.780079 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-71154c9a-0930-443e-83a7-05cd336d6598 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:00.780521 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-71154c9a-0930-443e-83a7-05cd336d6598 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:00.781352 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-71154c9a-0930-443e-83a7-05cd336d6598 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:00.781786 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-71154c9a-0930-443e-83a7-05cd336d6598 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:00.910070 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-04b8ce0a-df9f-42b2-85b3-b09dcf064452 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:00.919922 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-04b8ce0a-df9f-42b2-85b3-b09dcf064452 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:00.921523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-04b8ce0a-df9f-42b2-85b3-b09dcf064452 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:00.922808 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-04b8ce0a-df9f-42b2-85b3-b09dcf064452 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.213149 Jul 25 08:53:00.923376 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 396/754] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:53:00 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:53:00.927998 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-79b59b79-1b03-4707-8c39-665d1e187763 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:00.928617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-79b59b79-1b03-4707-8c39-665d1e187763 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:00.935529 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79b59b79-1b03-4707-8c39-665d1e187763 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:00.935987 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79b59b79-1b03-4707-8c39-665d1e187763 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:00.936796 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79b59b79-1b03-4707-8c39-665d1e187763 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:00.937220 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79b59b79-1b03-4707-8c39-665d1e187763 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:00.947372 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-71154c9a-0930-443e-83a7-05cd336d6598 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:00.955958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-71154c9a-0930-443e-83a7-05cd336d6598 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1680 microversion: 2.1 time: 0.188460 Jul 25 08:53:00.956546 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 359/755] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:00 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:01.098337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-79b59b79-1b03-4707-8c39-665d1e187763 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:01.112352 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-79b59b79-1b03-4707-8c39-665d1e187763 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.187591 Jul 25 08:53:01.113344 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 397/756] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:00 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:01.946344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-aceef14b-c427-47b1-b113-98e007bb4174 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:01.947001 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-aceef14b-c427-47b1-b113-98e007bb4174 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:01.955257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aceef14b-c427-47b1-b113-98e007bb4174 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:01.955702 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aceef14b-c427-47b1-b113-98e007bb4174 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:01.956643 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aceef14b-c427-47b1-b113-98e007bb4174 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:01.957074 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aceef14b-c427-47b1-b113-98e007bb4174 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:01.981727 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d101a59c-20a3-4be8-979b-3ae93f1a0404 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:01.982889 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d101a59c-20a3-4be8-979b-3ae93f1a0404 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:01.994334 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d101a59c-20a3-4be8-979b-3ae93f1a0404 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:01.995018 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d101a59c-20a3-4be8-979b-3ae93f1a0404 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:01.995999 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d101a59c-20a3-4be8-979b-3ae93f1a0404 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:01.997387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d101a59c-20a3-4be8-979b-3ae93f1a0404 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:02.165760 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-aceef14b-c427-47b1-b113-98e007bb4174 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:02.178256 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-aceef14b-c427-47b1-b113-98e007bb4174 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:02.180945 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-aceef14b-c427-47b1-b113-98e007bb4174 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:02.182761 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-aceef14b-c427-47b1-b113-98e007bb4174 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.240309 Jul 25 08:53:02.188628 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 360/757] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:53:01 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:53:02.188957 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d101a59c-20a3-4be8-979b-3ae93f1a0404 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:02.194301 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1423f85a-3ea8-4d7b-bda5-4bc04199f6aa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:02.195511 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1423f85a-3ea8-4d7b-bda5-4bc04199f6aa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:02.196213 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d101a59c-20a3-4be8-979b-3ae93f1a0404 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1680 microversion: 2.1 time: 0.220401 Jul 25 08:53:02.196888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 398/758] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:01 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:02.205706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1423f85a-3ea8-4d7b-bda5-4bc04199f6aa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:02.206486 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1423f85a-3ea8-4d7b-bda5-4bc04199f6aa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:02.207894 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1423f85a-3ea8-4d7b-bda5-4bc04199f6aa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:02.208712 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1423f85a-3ea8-4d7b-bda5-4bc04199f6aa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:02.377751 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1423f85a-3ea8-4d7b-bda5-4bc04199f6aa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:02.386561 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1423f85a-3ea8-4d7b-bda5-4bc04199f6aa tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.201236 Jul 25 08:53:02.387175 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 361/759] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:02 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:02.681425 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9595bc3e-e6a0-4299-914b-a9610bbca7ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:02.683683 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9595bc3e-e6a0-4299-914b-a9610bbca7ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:02.690002 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9595bc3e-e6a0-4299-914b-a9610bbca7ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:02.690454 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9595bc3e-e6a0-4299-914b-a9610bbca7ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:02.691228 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9595bc3e-e6a0-4299-914b-a9610bbca7ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:02.691664 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9595bc3e-e6a0-4299-914b-a9610bbca7ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:02.720017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-9595bc3e-e6a0-4299-914b-a9610bbca7ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lazy-loading 'flavor' on Instance uuid f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:53:02.863552 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9595bc3e-e6a0-4299-914b-a9610bbca7ae tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/action" status: 200 len: 32 microversion: 2.1 time: 0.185708 Jul 25 08:53:02.864875 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 399/760] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:53:02 2022] POST /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:53:02.875176 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-088fb8fe-018c-4b29-b305-05397ff8beb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:02.875800 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-088fb8fe-018c-4b29-b305-05397ff8beb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:02.883456 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-088fb8fe-018c-4b29-b305-05397ff8beb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:02.884228 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-088fb8fe-018c-4b29-b305-05397ff8beb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:02.885244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-088fb8fe-018c-4b29-b305-05397ff8beb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:02.886081 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-088fb8fe-018c-4b29-b305-05397ff8beb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:03.048170 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-088fb8fe-018c-4b29-b305-05397ff8beb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:03.058392 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-088fb8fe-018c-4b29-b305-05397ff8beb2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.187312 Jul 25 08:53:03.059195 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 362/761] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:02 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:03.216013 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a94f261c-96c8-42b5-8352-aca25124c601 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:03.217051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a94f261c-96c8-42b5-8352-aca25124c601 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:03.225821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7d0c83d7-5019-47fd-8beb-9596c098c4ee tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:03.226346 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a94f261c-96c8-42b5-8352-aca25124c601 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:03.226827 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a94f261c-96c8-42b5-8352-aca25124c601 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:03.227029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7d0c83d7-5019-47fd-8beb-9596c098c4ee tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:03.227632 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a94f261c-96c8-42b5-8352-aca25124c601 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:03.228102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a94f261c-96c8-42b5-8352-aca25124c601 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:03.234898 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7d0c83d7-5019-47fd-8beb-9596c098c4ee tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:03.235350 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7d0c83d7-5019-47fd-8beb-9596c098c4ee tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:03.236352 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7d0c83d7-5019-47fd-8beb-9596c098c4ee tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:03.236825 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7d0c83d7-5019-47fd-8beb-9596c098c4ee tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:03.701689 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7d0c83d7-5019-47fd-8beb-9596c098c4ee tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:03.711959 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a94f261c-96c8-42b5-8352-aca25124c601 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:03.714414 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7d0c83d7-5019-47fd-8beb-9596c098c4ee tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1680 microversion: 2.1 time: 0.493879 Jul 25 08:53:03.715704 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 363/762] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:03 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1680 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:03.729003 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a94f261c-96c8-42b5-8352-aca25124c601 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:03.733228 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a94f261c-96c8-42b5-8352-aca25124c601 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:03.735457 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a94f261c-96c8-42b5-8352-aca25124c601 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.524801 Jul 25 08:53:03.735868 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-def4bd2a-2b3a-4193-9354-19f51f44988f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:03.737151 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-def4bd2a-2b3a-4193-9354-19f51f44988f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:03.737441 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 400/763] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:53:03 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:53:03.754845 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-def4bd2a-2b3a-4193-9354-19f51f44988f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:03.755290 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-def4bd2a-2b3a-4193-9354-19f51f44988f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:03.756136 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-def4bd2a-2b3a-4193-9354-19f51f44988f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:03.756562 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-def4bd2a-2b3a-4193-9354-19f51f44988f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:03.953702 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-def4bd2a-2b3a-4193-9354-19f51f44988f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:03.962925 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-def4bd2a-2b3a-4193-9354-19f51f44988f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.246388 Jul 25 08:53:03.963511 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 364/764] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:03 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:04.083083 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ad602bdb-fe3e-4442-a7f1-7a16235de3fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:04.083696 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ad602bdb-fe3e-4442-a7f1-7a16235de3fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:04.089972 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad602bdb-fe3e-4442-a7f1-7a16235de3fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:04.094960 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad602bdb-fe3e-4442-a7f1-7a16235de3fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:04.094960 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad602bdb-fe3e-4442-a7f1-7a16235de3fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:04.094960 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad602bdb-fe3e-4442-a7f1-7a16235de3fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:04.236535 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ad602bdb-fe3e-4442-a7f1-7a16235de3fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:04.244723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ad602bdb-fe3e-4442-a7f1-7a16235de3fb tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.165610 Jul 25 08:53:04.245302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 401/765] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:04 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:04.749624 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5886ded7-67b5-486a-831c-8a66cbb7473c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:04.750357 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5886ded7-67b5-486a-831c-8a66cbb7473c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:04.757892 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5886ded7-67b5-486a-831c-8a66cbb7473c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:04.758647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5886ded7-67b5-486a-831c-8a66cbb7473c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:04.759806 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5886ded7-67b5-486a-831c-8a66cbb7473c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:04.760473 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5886ded7-67b5-486a-831c-8a66cbb7473c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:04.760932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-efab93cb-6bef-4b1d-b5a9-dbaba307cde5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:04.761747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-efab93cb-6bef-4b1d-b5a9-dbaba307cde5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:04.769884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-efab93cb-6bef-4b1d-b5a9-dbaba307cde5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:04.770331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-efab93cb-6bef-4b1d-b5a9-dbaba307cde5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:04.771105 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-efab93cb-6bef-4b1d-b5a9-dbaba307cde5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:04.771592 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-efab93cb-6bef-4b1d-b5a9-dbaba307cde5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:04.972968 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5886ded7-67b5-486a-831c-8a66cbb7473c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:04.983693 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5886ded7-67b5-486a-831c-8a66cbb7473c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1680 microversion: 2.1 time: 0.239967 Jul 25 08:53:04.984535 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 365/766] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:04 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:04.989248 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-efab93cb-6bef-4b1d-b5a9-dbaba307cde5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:04.993814 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6914e084-5e19-439f-a05f-614b2e3fbe49 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:04.994806 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6914e084-5e19-439f-a05f-614b2e3fbe49 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:05.004804 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-efab93cb-6bef-4b1d-b5a9-dbaba307cde5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:05.005004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6914e084-5e19-439f-a05f-614b2e3fbe49 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:05.005515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6914e084-5e19-439f-a05f-614b2e3fbe49 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:05.006808 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6914e084-5e19-439f-a05f-614b2e3fbe49 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:05.007409 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-efab93cb-6bef-4b1d-b5a9-dbaba307cde5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:05.007533 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6914e084-5e19-439f-a05f-614b2e3fbe49 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:05.009400 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-efab93cb-6bef-4b1d-b5a9-dbaba307cde5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.252654 Jul 25 08:53:05.010327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 402/767] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:53:04 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:53:05.176023 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-6914e084-5e19-439f-a05f-614b2e3fbe49 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:05.184208 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6914e084-5e19-439f-a05f-614b2e3fbe49 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.197825 Jul 25 08:53:05.184822 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 366/768] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:04 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:05.267462 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cf419484-02d8-4470-a9aa-04b422fc2315 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:05.268040 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cf419484-02d8-4470-a9aa-04b422fc2315 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:05.274627 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cf419484-02d8-4470-a9aa-04b422fc2315 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:05.275072 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cf419484-02d8-4470-a9aa-04b422fc2315 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:05.275840 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cf419484-02d8-4470-a9aa-04b422fc2315 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:05.276261 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cf419484-02d8-4470-a9aa-04b422fc2315 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:05.433066 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cf419484-02d8-4470-a9aa-04b422fc2315 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:05.441153 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cf419484-02d8-4470-a9aa-04b422fc2315 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.177523 Jul 25 08:53:05.441775 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 403/769] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:05 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:06.006394 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f5f51732-ee6d-48a5-98f4-23447193e07e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:06.006983 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f5f51732-ee6d-48a5-98f4-23447193e07e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:06.009484 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=46 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:06.015480 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f5f51732-ee6d-48a5-98f4-23447193e07e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:06.015932 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f5f51732-ee6d-48a5-98f4-23447193e07e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:06.016838 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f5f51732-ee6d-48a5-98f4-23447193e07e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:06.017232 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f5f51732-ee6d-48a5-98f4-23447193e07e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:06.036027 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e42c95ed-7454-48f9-8a53-996f431ff0d1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:06.036787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e42c95ed-7454-48f9-8a53-996f431ff0d1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:06.044459 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e42c95ed-7454-48f9-8a53-996f431ff0d1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:06.045134 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e42c95ed-7454-48f9-8a53-996f431ff0d1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:06.046269 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e42c95ed-7454-48f9-8a53-996f431ff0d1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:06.046973 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e42c95ed-7454-48f9-8a53-996f431ff0d1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:06.269017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f5f51732-ee6d-48a5-98f4-23447193e07e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:06.281325 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f5f51732-ee6d-48a5-98f4-23447193e07e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1680 microversion: 2.1 time: 0.278646 Jul 25 08:53:06.281476 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e42c95ed-7454-48f9-8a53-996f431ff0d1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:06.287247 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 367/770] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:06 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1680 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:06.296168 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e42c95ed-7454-48f9-8a53-996f431ff0d1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:06.298071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-88630dc0-ca3e-4d69-81ce-961d1e593714 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:06.298560 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e42c95ed-7454-48f9-8a53-996f431ff0d1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:06.298763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-88630dc0-ca3e-4d69-81ce-961d1e593714 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:06.299999 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e42c95ed-7454-48f9-8a53-996f431ff0d1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.267857 Jul 25 08:53:06.300772 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 404/771] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:53:06 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:53:06.314848 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-88630dc0-ca3e-4d69-81ce-961d1e593714 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:06.315295 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-88630dc0-ca3e-4d69-81ce-961d1e593714 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:06.316078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-88630dc0-ca3e-4d69-81ce-961d1e593714 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:06.316532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-88630dc0-ca3e-4d69-81ce-961d1e593714 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:06.470505 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3447ac12-34e9-48d2-8498-2a9ba4aee16e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:06.471042 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3447ac12-34e9-48d2-8498-2a9ba4aee16e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:06.477633 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3447ac12-34e9-48d2-8498-2a9ba4aee16e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:06.478417 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3447ac12-34e9-48d2-8498-2a9ba4aee16e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:06.479468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3447ac12-34e9-48d2-8498-2a9ba4aee16e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:06.479915 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3447ac12-34e9-48d2-8498-2a9ba4aee16e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:06.487441 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-88630dc0-ca3e-4d69-81ce-961d1e593714 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:06.495983 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-88630dc0-ca3e-4d69-81ce-961d1e593714 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.212084 Jul 25 08:53:06.496752 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 368/772] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:06 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:06.641051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3447ac12-34e9-48d2-8498-2a9ba4aee16e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:06.649526 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3447ac12-34e9-48d2-8498-2a9ba4aee16e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.183338 Jul 25 08:53:06.650093 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 405/773] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:06 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:07.305301 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4f202db4-0ae7-490d-907b-fe8de3969695 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:07.305846 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4f202db4-0ae7-490d-907b-fe8de3969695 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:07.312855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f202db4-0ae7-490d-907b-fe8de3969695 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:07.313312 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f202db4-0ae7-490d-907b-fe8de3969695 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:07.314078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f202db4-0ae7-490d-907b-fe8de3969695 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:07.314533 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4f202db4-0ae7-490d-907b-fe8de3969695 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:07.324718 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b52d83dd-bab8-40b4-a5ef-36b4e2ff1d21 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:07.325413 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b52d83dd-bab8-40b4-a5ef-36b4e2ff1d21 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:07.332211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b52d83dd-bab8-40b4-a5ef-36b4e2ff1d21 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:07.332722 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b52d83dd-bab8-40b4-a5ef-36b4e2ff1d21 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:07.333520 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b52d83dd-bab8-40b4-a5ef-36b4e2ff1d21 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:07.333975 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b52d83dd-bab8-40b4-a5ef-36b4e2ff1d21 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:07.509763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4f202db4-0ae7-490d-907b-fe8de3969695 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:07.520238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4f202db4-0ae7-490d-907b-fe8de3969695 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1680 microversion: 2.1 time: 0.218909 Jul 25 08:53:07.520863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 369/774] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:07 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:07.525663 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-11ce8509-b0bb-41e7-9c64-d2b1674aface tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:07.526465 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-11ce8509-b0bb-41e7-9c64-d2b1674aface tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:07.533097 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-11ce8509-b0bb-41e7-9c64-d2b1674aface tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:07.533551 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-11ce8509-b0bb-41e7-9c64-d2b1674aface tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:07.534321 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-11ce8509-b0bb-41e7-9c64-d2b1674aface tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:07.534754 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-11ce8509-b0bb-41e7-9c64-d2b1674aface tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:07.536633 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b52d83dd-bab8-40b4-a5ef-36b4e2ff1d21 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:07.547071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b52d83dd-bab8-40b4-a5ef-36b4e2ff1d21 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:07.548832 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b52d83dd-bab8-40b4-a5ef-36b4e2ff1d21 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:07.550208 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b52d83dd-bab8-40b4-a5ef-36b4e2ff1d21 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.229517 Jul 25 08:53:07.551033 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 406/775] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:53:07 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:53:07.679944 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5ea5e99e-14ad-4346-b64a-277b4421bff8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:07.680745 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5ea5e99e-14ad-4346-b64a-277b4421bff8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:07.687401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ea5e99e-14ad-4346-b64a-277b4421bff8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:07.687854 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ea5e99e-14ad-4346-b64a-277b4421bff8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:07.689090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ea5e99e-14ad-4346-b64a-277b4421bff8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:07.689214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ea5e99e-14ad-4346-b64a-277b4421bff8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:07.719572 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-11ce8509-b0bb-41e7-9c64-d2b1674aface tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:07.728791 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-11ce8509-b0bb-41e7-9c64-d2b1674aface tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.206820 Jul 25 08:53:07.730313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 370/776] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:07 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:07.816467 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-186bdd0e-9086-44e0-8890-0819f5ddf74f req-012cfa69-5f12-488b-b897-0326fd241024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4a347c-82ac-48e1-a31e-45f7eb643cda", "name": "network-vif-plugged", "status": "completed", "tag": "8fcdc018-b6d0-4c78-ac99-e89933f5caf7"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:07.828586 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-186bdd0e-9086-44e0-8890-0819f5ddf74f req-012cfa69-5f12-488b-b897-0326fd241024 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:07.829125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-186bdd0e-9086-44e0-8890-0819f5ddf74f req-012cfa69-5f12-488b-b897-0326fd241024 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:07.834592 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5ea5e99e-14ad-4346-b64a-277b4421bff8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:07.842232 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-186bdd0e-9086-44e0-8890-0819f5ddf74f req-012cfa69-5f12-488b-b897-0326fd241024 service nova] Creating event network-vif-plugged:8fcdc018-b6d0-4c78-ac99-e89933f5caf7 for instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda on hv-cinder-85084 Jul 25 08:53:07.843888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5ea5e99e-14ad-4346-b64a-277b4421bff8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.172714 Jul 25 08:53:07.844847 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 407/777] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:07 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:07.847822 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-186bdd0e-9086-44e0-8890-0819f5ddf74f req-012cfa69-5f12-488b-b897-0326fd241024 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038523 Jul 25 08:53:07.848609 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 371/778] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:53:08.543410 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9247ef40-2c9d-4c87-ab94-2280909ac5f5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:08.544264 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9247ef40-2c9d-4c87-ab94-2280909ac5f5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:08.552223 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9247ef40-2c9d-4c87-ab94-2280909ac5f5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:08.552804 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9247ef40-2c9d-4c87-ab94-2280909ac5f5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:08.553693 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9247ef40-2c9d-4c87-ab94-2280909ac5f5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:08.554161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9247ef40-2c9d-4c87-ab94-2280909ac5f5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:08.578629 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e814124c-6a2c-4e09-889d-a758e1c0bee7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:08.579393 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e814124c-6a2c-4e09-889d-a758e1c0bee7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:08.586021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e814124c-6a2c-4e09-889d-a758e1c0bee7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:08.586766 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e814124c-6a2c-4e09-889d-a758e1c0bee7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:08.587586 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e814124c-6a2c-4e09-889d-a758e1c0bee7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:08.588031 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e814124c-6a2c-4e09-889d-a758e1c0bee7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:08.772166 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9247ef40-2c9d-4c87-ab94-2280909ac5f5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:08.781141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9247ef40-2c9d-4c87-ab94-2280909ac5f5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1680 microversion: 2.1 time: 0.241672 Jul 25 08:53:08.781726 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 408/779] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:08 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:08.783567 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e814124c-6a2c-4e09-889d-a758e1c0bee7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:08.786398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-76897279-fcb0-44d9-8499-d8132479792b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:08.787154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-76897279-fcb0-44d9-8499-d8132479792b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:08.793625 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e814124c-6a2c-4e09-889d-a758e1c0bee7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:08.793861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-76897279-fcb0-44d9-8499-d8132479792b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:08.794271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-76897279-fcb0-44d9-8499-d8132479792b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:08.795374 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e814124c-6a2c-4e09-889d-a758e1c0bee7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:08.795778 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-76897279-fcb0-44d9-8499-d8132479792b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:08.795778 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-76897279-fcb0-44d9-8499-d8132479792b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:08.796915 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e814124c-6a2c-4e09-889d-a758e1c0bee7 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.223252 Jul 25 08:53:08.797960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 372/780] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:53:08 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:53:08.868464 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ad917755-d184-42ee-a0fc-5680cedcba9f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:08.869115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ad917755-d184-42ee-a0fc-5680cedcba9f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:08.875808 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad917755-d184-42ee-a0fc-5680cedcba9f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:08.876321 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad917755-d184-42ee-a0fc-5680cedcba9f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:08.877201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad917755-d184-42ee-a0fc-5680cedcba9f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:08.877632 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad917755-d184-42ee-a0fc-5680cedcba9f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:08.975641 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-76897279-fcb0-44d9-8499-d8132479792b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:08.984606 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-76897279-fcb0-44d9-8499-d8132479792b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.201761 Jul 25 08:53:08.985203 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 409/781] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:08 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:09.053283 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ad917755-d184-42ee-a0fc-5680cedcba9f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:09.055699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:09.063008 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ad917755-d184-42ee-a0fc-5680cedcba9f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.198538 Jul 25 08:53:09.063599 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 373/782] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:08 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:09.802299 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6696989b-63bd-44a7-8089-44534f741795 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:09.802923 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6696989b-63bd-44a7-8089-44534f741795 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:09.809983 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6696989b-63bd-44a7-8089-44534f741795 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:09.810997 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6696989b-63bd-44a7-8089-44534f741795 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:09.811786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6696989b-63bd-44a7-8089-44534f741795 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:09.812226 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6696989b-63bd-44a7-8089-44534f741795 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:09.819934 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1ebb869b-08bf-4261-bb28-07f3bd664b97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:09.820565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1ebb869b-08bf-4261-bb28-07f3bd664b97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:09.828169 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1ebb869b-08bf-4261-bb28-07f3bd664b97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:09.828661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1ebb869b-08bf-4261-bb28-07f3bd664b97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:09.829655 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1ebb869b-08bf-4261-bb28-07f3bd664b97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:09.829919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1ebb869b-08bf-4261-bb28-07f3bd664b97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:10.026078 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6696989b-63bd-44a7-8089-44534f741795 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:10.033509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6696989b-63bd-44a7-8089-44534f741795 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1680 microversion: 2.1 time: 0.235343 Jul 25 08:53:10.034168 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 410/783] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:09 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:10.038567 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c3595809-617f-4584-b01f-228a15180e58 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:10.038999 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1ebb869b-08bf-4261-bb28-07f3bd664b97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:10.039144 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c3595809-617f-4584-b01f-228a15180e58 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:10.045708 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3595809-617f-4584-b01f-228a15180e58 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:10.046209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3595809-617f-4584-b01f-228a15180e58 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:10.046980 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3595809-617f-4584-b01f-228a15180e58 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:10.047411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c3595809-617f-4584-b01f-228a15180e58 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:10.049613 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1ebb869b-08bf-4261-bb28-07f3bd664b97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:10.050310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:10.051347 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1ebb869b-08bf-4261-bb28-07f3bd664b97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:10.052821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1ebb869b-08bf-4261-bb28-07f3bd664b97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.237354 Jul 25 08:53:10.054642 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 374/784] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:53:09 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:53:10.085061 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-54c4ead0-d75e-4a62-aaa8-446939598672 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:10.085685 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-54c4ead0-d75e-4a62-aaa8-446939598672 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:10.092683 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54c4ead0-d75e-4a62-aaa8-446939598672 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:10.093140 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54c4ead0-d75e-4a62-aaa8-446939598672 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:10.093928 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54c4ead0-d75e-4a62-aaa8-446939598672 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:10.094367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54c4ead0-d75e-4a62-aaa8-446939598672 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:10.266141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c3595809-617f-4584-b01f-228a15180e58 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:10.275485 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c3595809-617f-4584-b01f-228a15180e58 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.240270 Jul 25 08:53:10.276071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 411/785] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:10 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:10.294923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-54c4ead0-d75e-4a62-aaa8-446939598672 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:10.303339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-54c4ead0-d75e-4a62-aaa8-446939598672 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.222328 Jul 25 08:53:10.303947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 375/786] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:10 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:11.055046 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-32af47dc-c15f-4a48-93c4-18808e4f9c5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:11.055734 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-32af47dc-c15f-4a48-93c4-18808e4f9c5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:11.062224 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32af47dc-c15f-4a48-93c4-18808e4f9c5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:11.062670 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32af47dc-c15f-4a48-93c4-18808e4f9c5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:11.063466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32af47dc-c15f-4a48-93c4-18808e4f9c5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:11.063903 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32af47dc-c15f-4a48-93c4-18808e4f9c5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:11.078411 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a66b16fd-2377-43fe-8a32-01cb981e2056 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:11.079512 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a66b16fd-2377-43fe-8a32-01cb981e2056 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:11.089032 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a66b16fd-2377-43fe-8a32-01cb981e2056 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:11.089623 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a66b16fd-2377-43fe-8a32-01cb981e2056 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:11.090876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a66b16fd-2377-43fe-8a32-01cb981e2056 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:11.092196 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a66b16fd-2377-43fe-8a32-01cb981e2056 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:11.322307 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-32af47dc-c15f-4a48-93c4-18808e4f9c5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:11.325414 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a66b16fd-2377-43fe-8a32-01cb981e2056 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:11.331861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-32af47dc-c15f-4a48-93c4-18808e4f9c5e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1680 microversion: 2.1 time: 0.280407 Jul 25 08:53:11.332453 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 412/787] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:11 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1680 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:11.337455 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6a46f070-f5ba-449d-b637-979170b975e0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:11.338066 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6a46f070-f5ba-449d-b637-979170b975e0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:11.346761 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6a46f070-f5ba-449d-b637-979170b975e0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:11.346761 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6a46f070-f5ba-449d-b637-979170b975e0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:11.346761 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6a46f070-f5ba-449d-b637-979170b975e0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:11.347315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6a46f070-f5ba-449d-b637-979170b975e0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:11.349617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a66b16fd-2377-43fe-8a32-01cb981e2056 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:11.352855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a66b16fd-2377-43fe-8a32-01cb981e2056 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:11.354197 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a66b16fd-2377-43fe-8a32-01cb981e2056 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1810 microversion: 2.20 time: 0.280600 Jul 25 08:53:11.363506 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 376/788] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:53:11 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1810 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:53:11.363506 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-20f43f22-18f4-4c5b-a3c5-ee8a8778bd4f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:11.363506 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-20f43f22-18f4-4c5b-a3c5-ee8a8778bd4f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:11.372259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20f43f22-18f4-4c5b-a3c5-ee8a8778bd4f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:11.374975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20f43f22-18f4-4c5b-a3c5-ee8a8778bd4f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:11.376704 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20f43f22-18f4-4c5b-a3c5-ee8a8778bd4f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:11.377530 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20f43f22-18f4-4c5b-a3c5-ee8a8778bd4f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:11.590404 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6a46f070-f5ba-449d-b637-979170b975e0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:11.599239 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6a46f070-f5ba-449d-b637-979170b975e0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.265469 Jul 25 08:53:11.600214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 413/789] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:11 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:11.609173 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-20f43f22-18f4-4c5b-a3c5-ee8a8778bd4f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:11.618005 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-20f43f22-18f4-4c5b-a3c5-ee8a8778bd4f tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.261746 Jul 25 08:53:11.621410 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 377/790] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:11 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:12.353630 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7f9d11d6-b358-45fe-9daa-3e8c573af2ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:12.354257 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7f9d11d6-b358-45fe-9daa-3e8c573af2ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:12.362426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f9d11d6-b358-45fe-9daa-3e8c573af2ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.362426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f9d11d6-b358-45fe-9daa-3e8c573af2ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.362869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f9d11d6-b358-45fe-9daa-3e8c573af2ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.363149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f9d11d6-b358-45fe-9daa-3e8c573af2ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.380142 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fa82740e-614d-4125-90fb-d9a6a1315fd0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:12.380887 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fa82740e-614d-4125-90fb-d9a6a1315fd0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:12.387527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fa82740e-614d-4125-90fb-d9a6a1315fd0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.387983 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fa82740e-614d-4125-90fb-d9a6a1315fd0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.388817 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fa82740e-614d-4125-90fb-d9a6a1315fd0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.389926 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fa82740e-614d-4125-90fb-d9a6a1315fd0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.579201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7f9d11d6-b358-45fe-9daa-3e8c573af2ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:12.587656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7f9d11d6-b358-45fe-9daa-3e8c573af2ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1657 microversion: 2.1 time: 0.237890 Jul 25 08:53:12.588251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 414/791] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:12 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1657 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:12.595065 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fa82740e-614d-4125-90fb-d9a6a1315fd0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:12.608645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5894ef4a-18fd-4413-8763-946ccd7881de tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:12.609018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fa82740e-614d-4125-90fb-d9a6a1315fd0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:12.611700 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fa82740e-614d-4125-90fb-d9a6a1315fd0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:12.613697 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fa82740e-614d-4125-90fb-d9a6a1315fd0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1797 microversion: 2.20 time: 0.238154 Jul 25 08:53:12.614802 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5894ef4a-18fd-4413-8763-946ccd7881de tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.615251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5894ef4a-18fd-4413-8763-946ccd7881de tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.616594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 378/792] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:53:12 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1797 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:53:12.622135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7f6841f4-1375-47d3-99ac-4f5a8da892a6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:12.623053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7f6841f4-1375-47d3-99ac-4f5a8da892a6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:12.633160 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7f6841f4-1375-47d3-99ac-4f5a8da892a6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.636040 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7f6841f4-1375-47d3-99ac-4f5a8da892a6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.636040 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7f6841f4-1375-47d3-99ac-4f5a8da892a6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.636040 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7f6841f4-1375-47d3-99ac-4f5a8da892a6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.644210 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5894ef4a-18fd-4413-8763-946ccd7881de tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Going to try to start instance {{(pid=124235) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 08:53:12.691227 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5894ef4a-18fd-4413-8763-946ccd7881de tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/action" status: 202 len: 0 microversion: 2.1 time: 0.086274 Jul 25 08:53:12.692626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 415/793] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:53:12 2022] POST /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 08:53:12.698383 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a716329d-37c9-434e-9e14-be1d6d74c999 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:12.699090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a716329d-37c9-434e-9e14-be1d6d74c999 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:12.705940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a716329d-37c9-434e-9e14-be1d6d74c999 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.706394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a716329d-37c9-434e-9e14-be1d6d74c999 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.707167 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a716329d-37c9-434e-9e14-be1d6d74c999 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.707599 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a716329d-37c9-434e-9e14-be1d6d74c999 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.891934 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7f6841f4-1375-47d3-99ac-4f5a8da892a6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:12.901506 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7f6841f4-1375-47d3-99ac-4f5a8da892a6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.283492 Jul 25 08:53:12.902027 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 379/794] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:12 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:12.904791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a716329d-37c9-434e-9e14-be1d6d74c999 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:12.907616 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2174c60b-ff98-4f21-9537-83858088b430 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:12.908460 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2174c60b-ff98-4f21-9537-83858088b430 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:12.915409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2174c60b-ff98-4f21-9537-83858088b430 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.916091 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2174c60b-ff98-4f21-9537-83858088b430 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.916518 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a716329d-37c9-434e-9e14-be1d6d74c999 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.222789 Jul 25 08:53:12.917097 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2174c60b-ff98-4f21-9537-83858088b430 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:12.917606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2174c60b-ff98-4f21-9537-83858088b430 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:12.922582 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 416/795] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:12 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:13.061736 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2174c60b-ff98-4f21-9537-83858088b430 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:13.069717 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2174c60b-ff98-4f21-9537-83858088b430 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1666 microversion: 2.1 time: 0.166648 Jul 25 08:53:13.070549 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 380/796] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:12 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:13.927168 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-91819163-2a2a-4759-b84e-54ab22caf6ad tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:13.928259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-91819163-2a2a-4759-b84e-54ab22caf6ad tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:13.932337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=64 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:13.941150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3a2f176a-9ef2-4b5b-8562-af86155bdf99 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:13.942380 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3a2f176a-9ef2-4b5b-8562-af86155bdf99 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:13.944156 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91819163-2a2a-4759-b84e-54ab22caf6ad tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:13.944977 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91819163-2a2a-4759-b84e-54ab22caf6ad tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:13.946364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91819163-2a2a-4759-b84e-54ab22caf6ad tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:13.947088 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91819163-2a2a-4759-b84e-54ab22caf6ad tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:13.951117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3a2f176a-9ef2-4b5b-8562-af86155bdf99 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:13.952699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3a2f176a-9ef2-4b5b-8562-af86155bdf99 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:13.953987 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3a2f176a-9ef2-4b5b-8562-af86155bdf99 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:13.954702 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3a2f176a-9ef2-4b5b-8562-af86155bdf99 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:14.178748 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3a2f176a-9ef2-4b5b-8562-af86155bdf99 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:14.184735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-91819163-2a2a-4759-b84e-54ab22caf6ad tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:14.189700 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3a2f176a-9ef2-4b5b-8562-af86155bdf99 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.253627 Jul 25 08:53:14.190296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 381/797] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:13 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:14.193056 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-91819163-2a2a-4759-b84e-54ab22caf6ad tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.273122 Jul 25 08:53:14.194073 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 417/798] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:13 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:14.194999 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b7c11ded-5713-4faf-b7e5-6ecbc439f2d3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:14.195611 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b7c11ded-5713-4faf-b7e5-6ecbc439f2d3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:14.201853 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b7c11ded-5713-4faf-b7e5-6ecbc439f2d3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:14.202520 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b7c11ded-5713-4faf-b7e5-6ecbc439f2d3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:14.203641 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b7c11ded-5713-4faf-b7e5-6ecbc439f2d3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:14.204138 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b7c11ded-5713-4faf-b7e5-6ecbc439f2d3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:14.354470 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b7c11ded-5713-4faf-b7e5-6ecbc439f2d3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:14.366016 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b7c11ded-5713-4faf-b7e5-6ecbc439f2d3 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1670 microversion: 2.1 time: 0.174519 Jul 25 08:53:14.366846 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 382/799] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:14 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:15.222955 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-be3f90f7-97df-4396-8194-74483a390b96 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:15.223550 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-be3f90f7-97df-4396-8194-74483a390b96 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:15.224037 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f72c696e-c0d2-4f9e-a3aa-4153034bf663 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:15.224689 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f72c696e-c0d2-4f9e-a3aa-4153034bf663 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:15.230337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be3f90f7-97df-4396-8194-74483a390b96 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:15.230781 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be3f90f7-97df-4396-8194-74483a390b96 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:15.231391 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f72c696e-c0d2-4f9e-a3aa-4153034bf663 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:15.231562 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be3f90f7-97df-4396-8194-74483a390b96 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:15.231848 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f72c696e-c0d2-4f9e-a3aa-4153034bf663 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:15.232010 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be3f90f7-97df-4396-8194-74483a390b96 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:15.232657 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f72c696e-c0d2-4f9e-a3aa-4153034bf663 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:15.233103 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f72c696e-c0d2-4f9e-a3aa-4153034bf663 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:15.456082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-be3f90f7-97df-4396-8194-74483a390b96 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:15.458497 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f72c696e-c0d2-4f9e-a3aa-4153034bf663 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:15.467444 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-be3f90f7-97df-4396-8194-74483a390b96 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.248826 Jul 25 08:53:15.467704 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f72c696e-c0d2-4f9e-a3aa-4153034bf663 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.248111 Jul 25 08:53:15.480599 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 418/800] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:15 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:15.481318 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 383/801] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:15 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:16.491653 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-57631712-0eff-4684-8a21-f400405cf8f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:16.492293 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-57631712-0eff-4684-8a21-f400405cf8f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:16.492755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7805a865-304a-4cd2-9031-156cc46bdfed tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:16.493405 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7805a865-304a-4cd2-9031-156cc46bdfed tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:16.498461 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-57631712-0eff-4684-8a21-f400405cf8f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:16.498912 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-57631712-0eff-4684-8a21-f400405cf8f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:16.499940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-57631712-0eff-4684-8a21-f400405cf8f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:16.500159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7805a865-304a-4cd2-9031-156cc46bdfed tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:16.500375 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-57631712-0eff-4684-8a21-f400405cf8f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:16.500631 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7805a865-304a-4cd2-9031-156cc46bdfed tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:16.501394 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7805a865-304a-4cd2-9031-156cc46bdfed tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:16.502497 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7805a865-304a-4cd2-9031-156cc46bdfed tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:16.715848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-57631712-0eff-4684-8a21-f400405cf8f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:16.722526 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7805a865-304a-4cd2-9031-156cc46bdfed tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:16.727258 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-57631712-0eff-4684-8a21-f400405cf8f7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.240808 Jul 25 08:53:16.728216 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 419/802] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:16 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:16.730909 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7805a865-304a-4cd2-9031-156cc46bdfed tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1758 microversion: 2.1 time: 0.242316 Jul 25 08:53:16.731640 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 384/803] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:16 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1758 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:17.752511 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-95679c38-ca65-4e54-ae37-bab0dfb7e84b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:17.753122 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-aca114a8-e663-4fc5-9be9-25419fa0027b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:17.753496 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-95679c38-ca65-4e54-ae37-bab0dfb7e84b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:17.753601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-aca114a8-e663-4fc5-9be9-25419fa0027b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:17.759946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95679c38-ca65-4e54-ae37-bab0dfb7e84b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:17.760195 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aca114a8-e663-4fc5-9be9-25419fa0027b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:17.760419 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95679c38-ca65-4e54-ae37-bab0dfb7e84b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:17.760553 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aca114a8-e663-4fc5-9be9-25419fa0027b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:17.761228 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95679c38-ca65-4e54-ae37-bab0dfb7e84b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:17.761347 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aca114a8-e663-4fc5-9be9-25419fa0027b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:17.761685 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95679c38-ca65-4e54-ae37-bab0dfb7e84b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:17.761838 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aca114a8-e663-4fc5-9be9-25419fa0027b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:17.965072 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-95679c38-ca65-4e54-ae37-bab0dfb7e84b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:17.973639 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-95679c38-ca65-4e54-ae37-bab0dfb7e84b tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.225149 Jul 25 08:53:17.974233 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 420/804] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:17 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:17.980191 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-aca114a8-e663-4fc5-9be9-25419fa0027b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:17.989606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-aca114a8-e663-4fc5-9be9-25419fa0027b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1761 microversion: 2.1 time: 0.240766 Jul 25 08:53:17.990193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 385/805] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:17 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1761 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:18.994586 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e12ad397-18de-41ed-ad8a-7211def80969 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:18.995215 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e12ad397-18de-41ed-ad8a-7211def80969 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:19.002816 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e12ad397-18de-41ed-ad8a-7211def80969 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:19.003266 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e12ad397-18de-41ed-ad8a-7211def80969 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:19.004041 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e12ad397-18de-41ed-ad8a-7211def80969 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:19.004477 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e12ad397-18de-41ed-ad8a-7211def80969 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:19.141198 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e12ad397-18de-41ed-ad8a-7211def80969 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:19.150160 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e12ad397-18de-41ed-ad8a-7211def80969 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.159344 Jul 25 08:53:19.150741 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 421/806] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:18 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:20.175171 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-df1fb516-2241-4c0d-a608-f1f00659431c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:20.176194 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-df1fb516-2241-4c0d-a608-f1f00659431c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:20.185659 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-df1fb516-2241-4c0d-a608-f1f00659431c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:20.186104 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-df1fb516-2241-4c0d-a608-f1f00659431c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:20.187033 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-df1fb516-2241-4c0d-a608-f1f00659431c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:20.187462 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-df1fb516-2241-4c0d-a608-f1f00659431c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:20.337442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-df1fb516-2241-4c0d-a608-f1f00659431c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:20.345765 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-df1fb516-2241-4c0d-a608-f1f00659431c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.176940 Jul 25 08:53:20.346384 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 386/807] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:20 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:21.366287 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5df20575-fdf3-4079-bb02-30a7554a256d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:21.366834 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5df20575-fdf3-4079-bb02-30a7554a256d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:21.373768 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5df20575-fdf3-4079-bb02-30a7554a256d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:21.374475 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5df20575-fdf3-4079-bb02-30a7554a256d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:21.375372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5df20575-fdf3-4079-bb02-30a7554a256d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:21.375789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5df20575-fdf3-4079-bb02-30a7554a256d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:21.530387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5df20575-fdf3-4079-bb02-30a7554a256d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:21.541226 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5df20575-fdf3-4079-bb02-30a7554a256d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.178870 Jul 25 08:53:21.541813 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 422/808] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:21 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:22.074755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-18d7e4b6-4577-4826-a18d-30fa12a395f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:22.075238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-18d7e4b6-4577-4826-a18d-30fa12a395f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:22.081618 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-18d7e4b6-4577-4826-a18d-30fa12a395f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:22.082063 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-18d7e4b6-4577-4826-a18d-30fa12a395f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:22.082864 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-18d7e4b6-4577-4826-a18d-30fa12a395f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:22.083334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-18d7e4b6-4577-4826-a18d-30fa12a395f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:22.107855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-18d7e4b6-4577-4826-a18d-30fa12a395f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08/ips" status: 200 len: 150 microversion: 2.1 time: 0.150614 Jul 25 08:53:22.108420 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 387/809] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Jul 25 08:53:21 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08/ips => generated 150 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:53:22.122328 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b82c263f-de9a-4a69-b3e4-935ce538895d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0033be9d-b38a-46f7-bbab-f061afb7b267"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:22.125146 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b82c263f-de9a-4a69-b3e4-935ce538895d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:22.132231 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b82c263f-de9a-4a69-b3e4-935ce538895d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:22.132710 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b82c263f-de9a-4a69-b3e4-935ce538895d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:22.133567 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b82c263f-de9a-4a69-b3e4-935ce538895d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:22.134091 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b82c263f-de9a-4a69-b3e4-935ce538895d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:22.216903 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-b82c263f-de9a-4a69-b3e4-935ce538895d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Invalid volume: volume 0033be9d-b38a-46f7-bbab-f061afb7b267 is already attached to instances: 51386e27-02e7-4b3c-8a7a-a13ede11e75e Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b82c263f-de9a-4a69-b3e4-935ce538895d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: POST /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08/os-volume_attachments HTTP/1.1 Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 74 Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:53:22.218554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {"volumeAttachment": {"volumeId": "0033be9d-b38a-46f7-bbab-f061afb7b267"}} Jul 25 08:53:22.221132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Invalid volume: volume 0033be9d-b38a-46f7-bbab-f061afb7b267 is already attached to instances: 51386e27-02e7-4b3c-8a7a-a13ede11e75e Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'server_id': 'd5263978-0aac-41bf-adad-05221bb69a08', 'body': {'volumeAttachment': {'volumeId': '0033be9d-b38a-46f7-bbab-f061afb7b267'}}} Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0033be9d-b38a-46f7-bbab-f061afb7b267 is already attached to instances: 51386e27-02e7-4b3c-8a7a-a13ede11e75e Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:53:22.222786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0033be9d-b38a-46f7-bbab-f061afb7b267 is already attached to instances: 51386e27-02e7-4b3c-8a7a-a13ede11e75e Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:22.225585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:53:22.227946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:53:22.227946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:53:22.227946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:53:22.227946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0033be9d-b38a-46f7-bbab-f061afb7b267 is already attached to instances: 51386e27-02e7-4b3c-8a7a-a13ede11e75e Jul 25 08:53:22.227946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:53:22.227946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b82c263f-de9a-4a69-b3e4-935ce538895d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 400 to user: Invalid volume: volume 0033be9d-b38a-46f7-bbab-f061afb7b267 is already attached to instances: 51386e27-02e7-4b3c-8a7a-a13ede11e75e {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:53:22.227946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b82c263f-de9a-4a69-b3e4-935ce538895d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101833 Jul 25 08:53:22.227946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 423/810] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:53:22 2022] POST /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 08:53:22.230844 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-70a7430e-06cd-469a-8fa4-5c30013d8686 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:22.231343 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-70a7430e-06cd-469a-8fa4-5c30013d8686 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:22.238287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-70a7430e-06cd-469a-8fa4-5c30013d8686 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:22.238735 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-70a7430e-06cd-469a-8fa4-5c30013d8686 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:22.239508 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-70a7430e-06cd-469a-8fa4-5c30013d8686 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:22.239943 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-70a7430e-06cd-469a-8fa4-5c30013d8686 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:22.266699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-70a7430e-06cd-469a-8fa4-5c30013d8686 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:53:22.344504 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-70a7430e-06cd-469a-8fa4-5c30013d8686 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 204 len: 0 microversion: 2.1 time: 0.117237 Jul 25 08:53:22.345124 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 388/811] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:53:22 2022] DELETE /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:53:22.353975 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cebe8c17-e462-40df-8fef-e2e9266f1f71 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:22.354587 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cebe8c17-e462-40df-8fef-e2e9266f1f71 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:22.364375 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cebe8c17-e462-40df-8fef-e2e9266f1f71 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:22.364880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cebe8c17-e462-40df-8fef-e2e9266f1f71 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:22.365672 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cebe8c17-e462-40df-8fef-e2e9266f1f71 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:22.366114 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cebe8c17-e462-40df-8fef-e2e9266f1f71 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:22.497591 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cebe8c17-e462-40df-8fef-e2e9266f1f71 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:22.505524 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cebe8c17-e462-40df-8fef-e2e9266f1f71 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1679 microversion: 2.1 time: 0.155362 Jul 25 08:53:22.506095 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 424/812] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:22 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:22.563609 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-22b83513-75ca-4121-bb5f-198f5084d335 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:22.564306 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-22b83513-75ca-4121-bb5f-198f5084d335 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:22.570699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-22b83513-75ca-4121-bb5f-198f5084d335 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:22.571013 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-22b83513-75ca-4121-bb5f-198f5084d335 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:22.571785 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-22b83513-75ca-4121-bb5f-198f5084d335 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:22.572213 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-22b83513-75ca-4121-bb5f-198f5084d335 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:22.575023 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:22.718686 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-22b83513-75ca-4121-bb5f-198f5084d335 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:22.727595 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-22b83513-75ca-4121-bb5f-198f5084d335 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.168219 Jul 25 08:53:22.728177 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 389/813] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:22 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:23.526100 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7374f3c9-fa1b-4601-b236-eec9656894ea tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:23.526706 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7374f3c9-fa1b-4601-b236-eec9656894ea tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:23.533519 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7374f3c9-fa1b-4601-b236-eec9656894ea tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:23.533966 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7374f3c9-fa1b-4601-b236-eec9656894ea tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:23.534721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7374f3c9-fa1b-4601-b236-eec9656894ea tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:23.535152 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7374f3c9-fa1b-4601-b236-eec9656894ea tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:23.668029 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7374f3c9-fa1b-4601-b236-eec9656894ea tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:23.676376 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7374f3c9-fa1b-4601-b236-eec9656894ea tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1679 microversion: 2.1 time: 0.154097 Jul 25 08:53:23.677193 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 425/814] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:23 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:23.749419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6372e99f-4361-4aa8-8c3f-9517541ceeb7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:23.750029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6372e99f-4361-4aa8-8c3f-9517541ceeb7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:23.757307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6372e99f-4361-4aa8-8c3f-9517541ceeb7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:23.757766 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6372e99f-4361-4aa8-8c3f-9517541ceeb7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:23.758969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6372e99f-4361-4aa8-8c3f-9517541ceeb7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:23.758969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6372e99f-4361-4aa8-8c3f-9517541ceeb7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:24.041117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-6372e99f-4361-4aa8-8c3f-9517541ceeb7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:24.050023 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6372e99f-4361-4aa8-8c3f-9517541ceeb7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.304108 Jul 25 08:53:24.050603 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 390/815] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:23 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:24.698628 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-758dcdf3-e49c-4806-8ce9-37a906ebc221 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:24.699236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-758dcdf3-e49c-4806-8ce9-37a906ebc221 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:24.706558 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-758dcdf3-e49c-4806-8ce9-37a906ebc221 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:24.707007 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-758dcdf3-e49c-4806-8ce9-37a906ebc221 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:24.707766 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-758dcdf3-e49c-4806-8ce9-37a906ebc221 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:24.708196 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-758dcdf3-e49c-4806-8ce9-37a906ebc221 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:24.839861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-758dcdf3-e49c-4806-8ce9-37a906ebc221 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:24.842098 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:24.849267 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-758dcdf3-e49c-4806-8ce9-37a906ebc221 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1679 microversion: 2.1 time: 0.154500 Jul 25 08:53:24.849866 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 426/816] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:24 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:25.071600 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5b49757b-34b6-4ffb-8ffd-58415bb1b93d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:25.072207 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5b49757b-34b6-4ffb-8ffd-58415bb1b93d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:25.078902 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5b49757b-34b6-4ffb-8ffd-58415bb1b93d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:25.079354 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5b49757b-34b6-4ffb-8ffd-58415bb1b93d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:25.080125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5b49757b-34b6-4ffb-8ffd-58415bb1b93d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:25.080557 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5b49757b-34b6-4ffb-8ffd-58415bb1b93d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:25.209236 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5b49757b-34b6-4ffb-8ffd-58415bb1b93d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:25.217218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5b49757b-34b6-4ffb-8ffd-58415bb1b93d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1737 microversion: 2.1 time: 0.149431 Jul 25 08:53:25.217771 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 391/817] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:25 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:25.870069 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9f27444c-2872-4c5a-86ab-e753b9ddd7e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:25.870680 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9f27444c-2872-4c5a-86ab-e753b9ddd7e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:25.878740 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f27444c-2872-4c5a-86ab-e753b9ddd7e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:25.879190 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f27444c-2872-4c5a-86ab-e753b9ddd7e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:25.880196 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f27444c-2872-4c5a-86ab-e753b9ddd7e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:25.882132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f27444c-2872-4c5a-86ab-e753b9ddd7e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:26.017455 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9f27444c-2872-4c5a-86ab-e753b9ddd7e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:26.025477 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9f27444c-2872-4c5a-86ab-e753b9ddd7e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1679 microversion: 2.1 time: 0.159174 Jul 25 08:53:26.026063 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 427/818] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:25 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:26.238548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3458883d-2885-4e93-96a2-e4e8998a34f2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:26.239179 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3458883d-2885-4e93-96a2-e4e8998a34f2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:26.246008 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3458883d-2885-4e93-96a2-e4e8998a34f2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:26.246453 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3458883d-2885-4e93-96a2-e4e8998a34f2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:26.247228 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3458883d-2885-4e93-96a2-e4e8998a34f2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:26.247761 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3458883d-2885-4e93-96a2-e4e8998a34f2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:26.398336 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3458883d-2885-4e93-96a2-e4e8998a34f2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:26.408046 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3458883d-2885-4e93-96a2-e4e8998a34f2 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1717 microversion: 2.1 time: 0.173381 Jul 25 08:53:26.408698 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 392/819] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:26 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1717 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:26.471845 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-87e665d2-e110-44c6-8326-ae1345c91e50 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:26.472298 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-87e665d2-e110-44c6-8326-ae1345c91e50 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:26.479698 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87e665d2-e110-44c6-8326-ae1345c91e50 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:26.480163 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87e665d2-e110-44c6-8326-ae1345c91e50 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:26.481036 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87e665d2-e110-44c6-8326-ae1345c91e50 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:26.481495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87e665d2-e110-44c6-8326-ae1345c91e50 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:26.580082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-87e665d2-e110-44c6-8326-ae1345c91e50 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] HTTP exception thrown: Cannot 'detach_volume' instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d while it is in vm_state rescued Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-87e665d2-e110-44c6-8326-ae1345c91e50 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Request method failure captured: Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: DELETE /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments/c7b7aba6-924b-445f-a60c-53b02ca7e4f4 HTTP/1.1 Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhAbHY67eQxIEbP7uZC63trv3RWNmE-jA4q-qfVkwamHlJqpEvc9tsVw9uR3CcU_zn9g9_Dy0hO19YlfNuDeBVc1FSa_xWLpptwFIXoXVOM5EcH3hxmFKKY6Sz8lkr-u8AfiW9Ly8IisZN4Iel1ZrDcboWjDo93zC7CUxuq-gvQGSs Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 7e61cbb537384f549eee9ec4c92d9d77 Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:53:26.581762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e61cbb537384f549eee9ec4c92d9d77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7e61cbb537384f549eee9ec4c92d9d77", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7e61cbb537384f549eee9ec4c92d9d77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e61cbb537384f549eee9ec4c92d9d77"}]}] Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 7e61cbb537384f549eee9ec4c92d9d77 Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-ServerRescueNegativeTestJSON-1864573966-project Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 238f78244df546e5a6fc1a4cd1b73288 Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1864573966-project Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:53:26.583340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Cannot 'detach_volume' instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d while it is in vm_state rescued Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'server_id': 'f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d', 'id': 'c7b7aba6-924b-445f-a60c-53b02ca7e4f4'} Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:53:26.587784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d while it is in vm_state rescued Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d while it is in vm_state rescued Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:53:26.589064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-87e665d2-e110-44c6-8326-ae1345c91e50 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Returning 409 to user: Cannot 'detach_volume' instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d while it is in vm_state rescued {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:53:26.590124 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-87e665d2-e110-44c6-8326-ae1345c91e50 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments/c7b7aba6-924b-445f-a60c-53b02ca7e4f4" status: 409 len: 152 microversion: 2.1 time: 0.115422 Jul 25 08:53:26.590124 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 428/820] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:53:26 2022] DELETE /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments/c7b7aba6-924b-445f-a60c-53b02ca7e4f4 => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 08:53:26.592746 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-534fecbf-799c-4e06-9876-60d281181ae8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:26.593324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-534fecbf-799c-4e06-9876-60d281181ae8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:26.599870 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-534fecbf-799c-4e06-9876-60d281181ae8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:26.600327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-534fecbf-799c-4e06-9876-60d281181ae8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:26.601163 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-534fecbf-799c-4e06-9876-60d281181ae8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:26.601822 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-534fecbf-799c-4e06-9876-60d281181ae8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:26.675471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-534fecbf-799c-4e06-9876-60d281181ae8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "POST /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/action" status: 202 len: 0 microversion: 2.1 time: 0.086626 Jul 25 08:53:26.676800 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 393/821] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:53:26 2022] POST /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:53:26.685228 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d3e67156-7c76-4317-b54f-98caf0479903 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:26.685961 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d3e67156-7c76-4317-b54f-98caf0479903 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:26.693383 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3e67156-7c76-4317-b54f-98caf0479903 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:26.693928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3e67156-7c76-4317-b54f-98caf0479903 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:26.694809 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3e67156-7c76-4317-b54f-98caf0479903 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:26.695319 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3e67156-7c76-4317-b54f-98caf0479903 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:26.792203 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-300029aa-c3b5-445d-804c-0b4974c24113 req-0aacc922-566c-48dd-ac7d-81b250883c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5263978-0aac-41bf-adad-05221bb69a08", "name": "network-vif-deleted", "tag": "702582ed-3157-4dee-b38e-d158d8ec1b75"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:26.806483 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-300029aa-c3b5-445d-804c-0b4974c24113 req-0aacc922-566c-48dd-ac7d-81b250883c21 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:26.807884 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-300029aa-c3b5-445d-804c-0b4974c24113 req-0aacc922-566c-48dd-ac7d-81b250883c21 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:26.836811 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-300029aa-c3b5-445d-804c-0b4974c24113 req-0aacc922-566c-48dd-ac7d-81b250883c21 service nova] Creating event network-vif-deleted:702582ed-3157-4dee-b38e-d158d8ec1b75 for instance d5263978-0aac-41bf-adad-05221bb69a08 on hv-cinder-85084 Jul 25 08:53:26.842999 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-300029aa-c3b5-445d-804c-0b4974c24113 req-0aacc922-566c-48dd-ac7d-81b250883c21 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055451 Jul 25 08:53:26.843970 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 394/822] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:53:26.911820 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d3e67156-7c76-4317-b54f-98caf0479903 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:26.922743 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d3e67156-7c76-4317-b54f-98caf0479903 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1725 microversion: 2.1 time: 0.241304 Jul 25 08:53:26.923332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 429/823] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:26 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:27.048018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:27.049276 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:27.057480 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:27.058265 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:27.059293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:27.059946 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:27.107660 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:27.108211 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:27.108879 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.objects.instance [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lazy-loading 'fault' on Instance uuid d5263978-0aac-41bf-adad-05221bb69a08 {{(pid=124234) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:53:27.155767 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:27.163827 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-98a9661e-f9e2-4390-baa6-05f1283711c4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 200 len: 1329 microversion: 2.1 time: 0.120056 Jul 25 08:53:27.164401 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 395/824] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:27 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 1329 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:27.947844 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-79692279-86c4-470a-ba72-ca23c3923ab7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:27.948497 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-79692279-86c4-470a-ba72-ca23c3923ab7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:27.955851 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79692279-86c4-470a-ba72-ca23c3923ab7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:27.956304 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79692279-86c4-470a-ba72-ca23c3923ab7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:27.957151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79692279-86c4-470a-ba72-ca23c3923ab7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:27.957596 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79692279-86c4-470a-ba72-ca23c3923ab7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:28.134370 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-79692279-86c4-470a-ba72-ca23c3923ab7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:28.144529 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-79692279-86c4-470a-ba72-ca23c3923ab7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1725 microversion: 2.1 time: 0.200602 Jul 25 08:53:28.145616 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 430/825] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:27 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:28.185943 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-10c57eac-644a-4514-812c-0afa334a2d31 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:28.186668 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-10c57eac-644a-4514-812c-0afa334a2d31 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:28.194181 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-10c57eac-644a-4514-812c-0afa334a2d31 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:28.194712 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-10c57eac-644a-4514-812c-0afa334a2d31 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:28.195567 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-10c57eac-644a-4514-812c-0afa334a2d31 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:28.196080 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-10c57eac-644a-4514-812c-0afa334a2d31 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:28.209902 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-10c57eac-644a-4514-812c-0afa334a2d31 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-10c57eac-644a-4514-812c-0afa334a2d31 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 HTTP/1.1 Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:53:28.211560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:53:28.213201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'd5263978-0aac-41bf-adad-05221bb69a08'} Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:53:28.214053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:53:28.215246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:53:28.216390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-10c57eac-644a-4514-812c-0afa334a2d31 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:53:28.216390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-10c57eac-644a-4514-812c-0afa334a2d31 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 404 len: 111 microversion: 2.1 time: 0.031037 Jul 25 08:53:28.216390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 396/826] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:28 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:53:28.222375 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-09506671-8ad9-4402-9330-b87a681a3c2b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '.version_select at 0x7f0f79970a60>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:28.244846 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-09506671-8ad9-4402-9330-b87a681a3c2b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24328302" status: 202 len: 0 microversion: 2.1 time: 0.026154 Jul 25 08:53:28.245452 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 431/827] 10.222.0.52 () {58 vars in 1215 bytes} [Mon Jul 25 08:53:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24328302 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:53:29.016287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-cec30109-28e4-4617-9be4-08c453f44384 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:29.016819 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-cec30109-28e4-4617-9be4-08c453f44384 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:29.025657 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cec30109-28e4-4617-9be4-08c453f44384 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:29.026366 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cec30109-28e4-4617-9be4-08c453f44384 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:29.027239 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cec30109-28e4-4617-9be4-08c453f44384 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:29.027676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cec30109-28e4-4617-9be4-08c453f44384 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:29.120646 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.objects.instance [None req-cec30109-28e4-4617-9be4-08c453f44384 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lazy-loading 'services' on Instance uuid 51386e27-02e7-4b3c-8a7a-a13ede11e75e {{(pid=124234) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:53:29.165965 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-653de37a-e0e4-4a74-95b3-4565b04bf5a7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:29.167282 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-653de37a-e0e4-4a74-95b3-4565b04bf5a7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:29.174784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-653de37a-e0e4-4a74-95b3-4565b04bf5a7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:29.175234 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-653de37a-e0e4-4a74-95b3-4565b04bf5a7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:29.176181 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-653de37a-e0e4-4a74-95b3-4565b04bf5a7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:29.176654 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-653de37a-e0e4-4a74-95b3-4565b04bf5a7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:29.214648 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-cec30109-28e4-4617-9be4-08c453f44384 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments/0033be9d-b38a-46f7-bbab-f061afb7b267" status: 202 len: 0 microversion: 2.1 time: 0.202343 Jul 25 08:53:29.216267 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 397/828] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:53:29 2022] DELETE /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments/0033be9d-b38a-46f7-bbab-f061afb7b267 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 08:53:29.231316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-54d49d1d-2bdd-48cc-86dc-500b61e1bace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:29.234651 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-54d49d1d-2bdd-48cc-86dc-500b61e1bace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:29.246215 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54d49d1d-2bdd-48cc-86dc-500b61e1bace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:29.247038 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54d49d1d-2bdd-48cc-86dc-500b61e1bace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:29.248480 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54d49d1d-2bdd-48cc-86dc-500b61e1bace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:29.249551 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-54d49d1d-2bdd-48cc-86dc-500b61e1bace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:29.285373 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-54d49d1d-2bdd-48cc-86dc-500b61e1bace tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062850 Jul 25 08:53:29.285926 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 398/829] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:53:29 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:53:29.346391 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-653de37a-e0e4-4a74-95b3-4565b04bf5a7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:29.354668 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-653de37a-e0e4-4a74-95b3-4565b04bf5a7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1725 microversion: 2.1 time: 0.192621 Jul 25 08:53:29.355237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 432/830] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:29 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:30.298208 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d7498692-6a29-47af-97e0-54e027731cee tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:30.300375 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d7498692-6a29-47af-97e0-54e027731cee tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:30.307377 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d7498692-6a29-47af-97e0-54e027731cee tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:30.307824 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d7498692-6a29-47af-97e0-54e027731cee tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:30.308616 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d7498692-6a29-47af-97e0-54e027731cee tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:30.309060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d7498692-6a29-47af-97e0-54e027731cee tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:30.339092 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d7498692-6a29-47af-97e0-54e027731cee tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Jul 25 08:53:30.339657 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 399/831] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:53:30 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:53:30.376152 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c217ac76-880c-4c26-b6ad-7e20b2ed2eb5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:30.376791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c217ac76-880c-4c26-b6ad-7e20b2ed2eb5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:30.383408 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c217ac76-880c-4c26-b6ad-7e20b2ed2eb5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:30.383863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c217ac76-880c-4c26-b6ad-7e20b2ed2eb5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:30.384677 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c217ac76-880c-4c26-b6ad-7e20b2ed2eb5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:30.385116 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c217ac76-880c-4c26-b6ad-7e20b2ed2eb5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:30.529370 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c217ac76-880c-4c26-b6ad-7e20b2ed2eb5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:30.538069 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c217ac76-880c-4c26-b6ad-7e20b2ed2eb5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1725 microversion: 2.1 time: 0.166011 Jul 25 08:53:30.538672 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 433/832] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:30 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:31.353959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d6627539-5c22-4f0b-bacc-063e5ffa1b76 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:31.356203 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d6627539-5c22-4f0b-bacc-063e5ffa1b76 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:31.363744 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6627539-5c22-4f0b-bacc-063e5ffa1b76 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:31.364174 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6627539-5c22-4f0b-bacc-063e5ffa1b76 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:31.364999 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6627539-5c22-4f0b-bacc-063e5ffa1b76 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:31.365438 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6627539-5c22-4f0b-bacc-063e5ffa1b76 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:31.397160 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d6627539-5c22-4f0b-bacc-063e5ffa1b76 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047437 Jul 25 08:53:31.397731 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 400/833] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:53:31 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:53:31.561254 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-84abb5fb-f899-488e-b5de-ea2cc5e10cf4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:31.561810 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-84abb5fb-f899-488e-b5de-ea2cc5e10cf4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:31.568713 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-84abb5fb-f899-488e-b5de-ea2cc5e10cf4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:31.569169 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-84abb5fb-f899-488e-b5de-ea2cc5e10cf4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:31.570652 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-84abb5fb-f899-488e-b5de-ea2cc5e10cf4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:31.570652 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-84abb5fb-f899-488e-b5de-ea2cc5e10cf4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:31.712860 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-84abb5fb-f899-488e-b5de-ea2cc5e10cf4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:31.721150 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-84abb5fb-f899-488e-b5de-ea2cc5e10cf4 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1731 microversion: 2.1 time: 0.163820 Jul 25 08:53:31.721737 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 434/834] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:31 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:31.742498 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-05a6909e-981c-4634-82ad-40d561b47a35 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:31.743000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-05a6909e-981c-4634-82ad-40d561b47a35 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:31.749635 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-05a6909e-981c-4634-82ad-40d561b47a35 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:31.750092 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-05a6909e-981c-4634-82ad-40d561b47a35 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:31.750875 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-05a6909e-981c-4634-82ad-40d561b47a35 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:31.751319 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-05a6909e-981c-4634-82ad-40d561b47a35 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:31.845716 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-05a6909e-981c-4634-82ad-40d561b47a35 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107123 Jul 25 08:53:31.846324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 401/835] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Jul 25 08:53:31 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:53:32.415877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-eab5bfea-50ae-4a0a-bcfd-bd4045e6d260 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:32.421157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-eab5bfea-50ae-4a0a-bcfd-bd4045e6d260 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:32.433802 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eab5bfea-50ae-4a0a-bcfd-bd4045e6d260 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:32.434692 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eab5bfea-50ae-4a0a-bcfd-bd4045e6d260 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:32.435765 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eab5bfea-50ae-4a0a-bcfd-bd4045e6d260 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:32.436846 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eab5bfea-50ae-4a0a-bcfd-bd4045e6d260 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:32.478903 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-eab5bfea-50ae-4a0a-bcfd-bd4045e6d260 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070949 Jul 25 08:53:32.479715 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 435/836] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:53:32 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:53:32.580400 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-802d0024-5d24-4f55-a707-26c64286ccc5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:32.581088 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-802d0024-5d24-4f55-a707-26c64286ccc5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:32.591192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-802d0024-5d24-4f55-a707-26c64286ccc5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:32.591893 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-802d0024-5d24-4f55-a707-26c64286ccc5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:32.593155 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-802d0024-5d24-4f55-a707-26c64286ccc5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:32.593802 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-802d0024-5d24-4f55-a707-26c64286ccc5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:32.623748 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-802d0024-5d24-4f55-a707-26c64286ccc5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:53:32.725589 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-802d0024-5d24-4f55-a707-26c64286ccc5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 204 len: 0 microversion: 2.1 time: 0.152014 Jul 25 08:53:32.728714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 402/837] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:53:32 2022] DELETE /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:53:32.736492 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-89ba7bb5-4d61-47d1-b125-30c3c800249b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:32.737356 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-89ba7bb5-4d61-47d1-b125-30c3c800249b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:32.745309 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-89ba7bb5-4d61-47d1-b125-30c3c800249b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:32.745973 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-89ba7bb5-4d61-47d1-b125-30c3c800249b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:32.746887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-89ba7bb5-4d61-47d1-b125-30c3c800249b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:32.747398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-89ba7bb5-4d61-47d1-b125-30c3c800249b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:32.915873 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-89ba7bb5-4d61-47d1-b125-30c3c800249b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:32.930367 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-89ba7bb5-4d61-47d1-b125-30c3c800249b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1681 microversion: 2.1 time: 0.198758 Jul 25 08:53:32.932311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 436/838] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:32 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:33.291033 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-42c93e1a-ed1e-4b65-bf3f-2b2975c9d4ba req-0cd05944-42f8-4b71-b465-85f33428f05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d", "tag": "39973804-976f-4223-a900-f8cbbe4dcd0e"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:33.304554 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-42c93e1a-ed1e-4b65-bf3f-2b2975c9d4ba req-0cd05944-42f8-4b71-b465-85f33428f05b service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:33.305102 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-42c93e1a-ed1e-4b65-bf3f-2b2975c9d4ba req-0cd05944-42f8-4b71-b465-85f33428f05b service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:33.323420 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-42c93e1a-ed1e-4b65-bf3f-2b2975c9d4ba req-0cd05944-42f8-4b71-b465-85f33428f05b service nova] Creating event network-changed:39973804-976f-4223-a900-f8cbbe4dcd0e for instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d on hv-cinder-85084 Jul 25 08:53:33.331252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-42c93e1a-ed1e-4b65-bf3f-2b2975c9d4ba req-0cd05944-42f8-4b71-b465-85f33428f05b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044695 Jul 25 08:53:33.332407 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 403/839] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:53:33.960423 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-11bacceb-f5b2-409f-b639-0304f436929e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:33.961168 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-11bacceb-f5b2-409f-b639-0304f436929e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:33.968337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11bacceb-f5b2-409f-b639-0304f436929e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:33.968936 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11bacceb-f5b2-409f-b639-0304f436929e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:33.969986 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11bacceb-f5b2-409f-b639-0304f436929e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:33.970498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11bacceb-f5b2-409f-b639-0304f436929e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:34.154045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-11bacceb-f5b2-409f-b639-0304f436929e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:34.170162 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-11bacceb-f5b2-409f-b639-0304f436929e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1681 microversion: 2.1 time: 0.213652 Jul 25 08:53:34.170830 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 437/840] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:33 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:35.211743 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7a3f7153-e566-4101-b58e-8f2dd07851d7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:35.212826 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7a3f7153-e566-4101-b58e-8f2dd07851d7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:35.221204 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7a3f7153-e566-4101-b58e-8f2dd07851d7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:35.221649 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7a3f7153-e566-4101-b58e-8f2dd07851d7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:35.222711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7a3f7153-e566-4101-b58e-8f2dd07851d7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:35.223260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7a3f7153-e566-4101-b58e-8f2dd07851d7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:35.240027 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:35.306474 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7a3f7153-e566-4101-b58e-8f2dd07851d7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:35.314736 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7a3f7153-e566-4101-b58e-8f2dd07851d7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 200 len: 1326 microversion: 2.1 time: 0.108059 Jul 25 08:53:35.315439 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 404/841] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:35 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:35.350768 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-54ba5370-5d5b-402c-862e-26a62faabd44 req-3794ebfa-a472-4f2c-81b8-235668de8e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d", "tag": "39973804-976f-4223-a900-f8cbbe4dcd0e"}, {"server_uuid": "51386e27-02e7-4b3c-8a7a-a13ede11e75e", "name": "network-vif-deleted", "tag": "653cd8da-6a1d-469a-82fe-d6dbe5f44308"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:35.370437 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-54ba5370-5d5b-402c-862e-26a62faabd44 req-3794ebfa-a472-4f2c-81b8-235668de8e4d service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:35.371189 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-54ba5370-5d5b-402c-862e-26a62faabd44 req-3794ebfa-a472-4f2c-81b8-235668de8e4d service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:35.396601 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-54ba5370-5d5b-402c-862e-26a62faabd44 req-3794ebfa-a472-4f2c-81b8-235668de8e4d service nova] Creating event network-changed:39973804-976f-4223-a900-f8cbbe4dcd0e for instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d on hv-cinder-85084 Jul 25 08:53:35.397247 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-54ba5370-5d5b-402c-862e-26a62faabd44 req-3794ebfa-a472-4f2c-81b8-235668de8e4d service nova] Creating event network-vif-deleted:653cd8da-6a1d-469a-82fe-d6dbe5f44308 for instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e on hv-cinder-85084 Jul 25 08:53:35.404071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-54ba5370-5d5b-402c-862e-26a62faabd44 req-3794ebfa-a472-4f2c-81b8-235668de8e4d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.057287 Jul 25 08:53:35.405305 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 438/842] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:53:36.337533 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1460f86d-a105-4e64-82e0-67f655bd0743 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:36.338150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1460f86d-a105-4e64-82e0-67f655bd0743 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:36.341558 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:36.345393 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1460f86d-a105-4e64-82e0-67f655bd0743 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:36.345876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1460f86d-a105-4e64-82e0-67f655bd0743 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:36.346696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1460f86d-a105-4e64-82e0-67f655bd0743 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:36.347226 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1460f86d-a105-4e64-82e0-67f655bd0743 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:36.364941 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-1460f86d-a105-4e64-82e0-67f655bd0743 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1460f86d-a105-4e64-82e0-67f655bd0743 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e HTTP/1.1 Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:53:36.366610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:53:36.368135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '51386e27-02e7-4b3c-8a7a-a13ede11e75e'} Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:53:36.369162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:53:36.370583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:53:36.372188 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1460f86d-a105-4e64-82e0-67f655bd0743 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:53:36.372188 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1460f86d-a105-4e64-82e0-67f655bd0743 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 404 len: 111 microversion: 2.1 time: 0.034364 Jul 25 08:53:36.372188 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 405/843] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:36 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:53:36.378486 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-da7380d4-edc9-47ac-a2da-9a2b913cde2b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '.version_select at 0x7f0f799c2790>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:36.399294 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-da7380d4-edc9-47ac-a2da-9a2b913cde2b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-221134369" status: 202 len: 0 microversion: 2.1 time: 0.025928 Jul 25 08:53:36.399888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 439/844] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Jul 25 08:53:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-221134369 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:53:37.068645 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9d57946e-e517-42bc-8640-9693f138eef8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: .version_select at 0x7f0f798bb1f0>, body: {"keypair": {"name": "tempest-keypair-972595416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfhL0xNYpmxAMV5hEtcP65avxd17ukegSOIQy4z0Yg6Hmm8HBuoqIQWVoN8WCQq5H42Wt5WNyZurRppWMzBoJoZWPR2zkfpIhAYa7byqXeLSa+felgt38PAhpRXe5ZdMQ=="}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:37.084335 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-9d57946e-e517-42bc-8640-9693f138eef8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:53:37.088426 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-9d57946e-e517-42bc-8640-9693f138eef8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for user 8e682232b7374450a7265e092602a5a6 and project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:53:37.114048 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9d57946e-e517-42bc-8640-9693f138eef8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050064 Jul 25 08:53:37.114679 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 406/845] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Jul 25 08:53:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:53:38.407254 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-801747138", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ca11239-7898-4751-a9c6-3b03bbecba12"}], "security_groups": [{"name": "tempest-securitygroup--2133930682"}], "key_name": "tempest-keypair-972595416", "user_data": "}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:38.512001 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] validate_networks() for [('6ca11239-7898-4751-a9c6-3b03bbecba12', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:53:39.213451 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:53:39.213871 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:53:39.214345 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:53:39.214758 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:53:39.215169 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:53:39.225311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:39.225765 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:39.226566 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:39.227004 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:39.244142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:53:39.248208 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for user 8e682232b7374450a7265e092602a5a6 and project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:53:39.259887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:53:39.262296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:53:39.312847 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f2604988-ff2b-4b40-a82e-a162a3a47b6d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.910319 Jul 25 08:53:39.313506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 440/846] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:53:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:53:39.324539 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7cd709ff-d195-49ee-9cf4-fd0ca94f36b3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:39.325230 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7cd709ff-d195-49ee-9cf4-fd0ca94f36b3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:39.380975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7cd709ff-d195-49ee-9cf4-fd0ca94f36b3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:39.389679 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7cd709ff-d195-49ee-9cf4-fd0ca94f36b3 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1240 microversion: 2.1 time: 0.069071 Jul 25 08:53:39.390250 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 407/847] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:39 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:40.412109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f5c12aba-2e30-48b1-a2c5-6476c30f37e7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:40.412931 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f5c12aba-2e30-48b1-a2c5-6476c30f37e7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:40.420086 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f5c12aba-2e30-48b1-a2c5-6476c30f37e7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:40.420530 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f5c12aba-2e30-48b1-a2c5-6476c30f37e7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:40.421355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f5c12aba-2e30-48b1-a2c5-6476c30f37e7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:40.421793 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f5c12aba-2e30-48b1-a2c5-6476c30f37e7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:40.494802 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f5c12aba-2e30-48b1-a2c5-6476c30f37e7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:40.503325 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f5c12aba-2e30-48b1-a2c5-6476c30f37e7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1300 microversion: 2.1 time: 0.095710 Jul 25 08:53:40.510893 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 441/848] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:40 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:41.523353 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8b4da65f-b93e-4975-b300-a618065e26db tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:41.523960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-8b4da65f-b93e-4975-b300-a618065e26db tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:41.530540 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8b4da65f-b93e-4975-b300-a618065e26db tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:41.530986 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8b4da65f-b93e-4975-b300-a618065e26db tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:41.531759 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8b4da65f-b93e-4975-b300-a618065e26db tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:41.532193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8b4da65f-b93e-4975-b300-a618065e26db tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:41.671066 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8b4da65f-b93e-4975-b300-a618065e26db tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:41.681173 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8b4da65f-b93e-4975-b300-a618065e26db tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1366 microversion: 2.1 time: 0.161543 Jul 25 08:53:41.682478 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 408/849] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:41 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:41.930925 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-7847ed27-b19b-423f-9eb9-c15501401e80 req-90418fbf-502f-4c92-93ac-60755098d33b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5c94565-b030-4cad-a705-425ace6d71ff", "tag": "62088a84-476c-4db4-baa2-473b1dbbc579"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:41.946972 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7847ed27-b19b-423f-9eb9-c15501401e80 req-90418fbf-502f-4c92-93ac-60755098d33b service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:41.947408 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7847ed27-b19b-423f-9eb9-c15501401e80 req-90418fbf-502f-4c92-93ac-60755098d33b service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:41.961749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-7847ed27-b19b-423f-9eb9-c15501401e80 req-90418fbf-502f-4c92-93ac-60755098d33b service nova] Creating event network-changed:62088a84-476c-4db4-baa2-473b1dbbc579 for instance c5c94565-b030-4cad-a705-425ace6d71ff on hv-cinder-85084 Jul 25 08:53:41.966142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-7847ed27-b19b-423f-9eb9-c15501401e80 req-90418fbf-502f-4c92-93ac-60755098d33b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044012 Jul 25 08:53:41.966752 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 442/850] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:53:42.704401 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f1ddbfb3-947a-4fe3-b5da-5e41e0558a99 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:42.705030 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f1ddbfb3-947a-4fe3-b5da-5e41e0558a99 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:42.711774 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1ddbfb3-947a-4fe3-b5da-5e41e0558a99 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:42.712223 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1ddbfb3-947a-4fe3-b5da-5e41e0558a99 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:42.713029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1ddbfb3-947a-4fe3-b5da-5e41e0558a99 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:42.713469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1ddbfb3-947a-4fe3-b5da-5e41e0558a99 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:42.853494 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f1ddbfb3-947a-4fe3-b5da-5e41e0558a99 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:42.860952 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f1ddbfb3-947a-4fe3-b5da-5e41e0558a99 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1366 microversion: 2.1 time: 0.160385 Jul 25 08:53:42.861515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 409/851] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:42 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:43.884414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-faceab51-4cc7-4a8b-8b43-7d647cd8c789 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:43.885126 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-faceab51-4cc7-4a8b-8b43-7d647cd8c789 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:43.891642 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-faceab51-4cc7-4a8b-8b43-7d647cd8c789 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:43.892088 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-faceab51-4cc7-4a8b-8b43-7d647cd8c789 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:43.892888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-faceab51-4cc7-4a8b-8b43-7d647cd8c789 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:43.893318 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-faceab51-4cc7-4a8b-8b43-7d647cd8c789 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:44.037618 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-faceab51-4cc7-4a8b-8b43-7d647cd8c789 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:44.045348 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-faceab51-4cc7-4a8b-8b43-7d647cd8c789 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1366 microversion: 2.1 time: 0.165621 Jul 25 08:53:44.045931 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 443/852] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:43 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:45.067791 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fb021462-d66c-4865-8444-3980d9becbd6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:45.068725 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fb021462-d66c-4865-8444-3980d9becbd6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:45.075935 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fb021462-d66c-4865-8444-3980d9becbd6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:45.076390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fb021462-d66c-4865-8444-3980d9becbd6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:45.077217 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fb021462-d66c-4865-8444-3980d9becbd6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:45.077656 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fb021462-d66c-4865-8444-3980d9becbd6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:45.219012 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fb021462-d66c-4865-8444-3980d9becbd6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:45.226871 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fb021462-d66c-4865-8444-3980d9becbd6 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1366 microversion: 2.1 time: 0.163981 Jul 25 08:53:45.227471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 410/853] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:45 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:46.258145 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-de6072d6-1d15-437f-9bb5-b3f8257cdc63 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:46.258783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-de6072d6-1d15-437f-9bb5-b3f8257cdc63 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:46.261248 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:46.266309 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de6072d6-1d15-437f-9bb5-b3f8257cdc63 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:46.266759 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de6072d6-1d15-437f-9bb5-b3f8257cdc63 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:46.267531 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de6072d6-1d15-437f-9bb5-b3f8257cdc63 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:46.267963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de6072d6-1d15-437f-9bb5-b3f8257cdc63 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:46.411801 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-de6072d6-1d15-437f-9bb5-b3f8257cdc63 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:46.419926 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-de6072d6-1d15-437f-9bb5-b3f8257cdc63 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1366 microversion: 2.1 time: 0.165572 Jul 25 08:53:46.420505 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 444/854] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:46 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:53:47.440904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8a6f5d87-dfe1-4d74-a60c-48f5c710f04c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:47.441523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-8a6f5d87-dfe1-4d74-a60c-48f5c710f04c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:47.448204 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8a6f5d87-dfe1-4d74-a60c-48f5c710f04c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:47.448696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8a6f5d87-dfe1-4d74-a60c-48f5c710f04c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:47.449483 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8a6f5d87-dfe1-4d74-a60c-48f5c710f04c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:47.449924 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8a6f5d87-dfe1-4d74-a60c-48f5c710f04c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:47.584431 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8a6f5d87-dfe1-4d74-a60c-48f5c710f04c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:47.592252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8a6f5d87-dfe1-4d74-a60c-48f5c710f04c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1366 microversion: 2.1 time: 0.155213 Jul 25 08:53:47.592885 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 411/855] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:47 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:47.962414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-406d00ca-5a99-4ecb-9300-ff13bc77afe4 req-c1c33528-72b5-43c3-8836-68e5ea1d5c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5c94565-b030-4cad-a705-425ace6d71ff", "name": "network-vif-plugged", "status": "completed", "tag": "62088a84-476c-4db4-baa2-473b1dbbc579"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:47.975689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-406d00ca-5a99-4ecb-9300-ff13bc77afe4 req-c1c33528-72b5-43c3-8836-68e5ea1d5c0b service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:47.976192 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-406d00ca-5a99-4ecb-9300-ff13bc77afe4 req-c1c33528-72b5-43c3-8836-68e5ea1d5c0b service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:47.988762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-406d00ca-5a99-4ecb-9300-ff13bc77afe4 req-c1c33528-72b5-43c3-8836-68e5ea1d5c0b service nova] Creating event network-vif-plugged:62088a84-476c-4db4-baa2-473b1dbbc579 for instance c5c94565-b030-4cad-a705-425ace6d71ff on hv-cinder-85084 Jul 25 08:53:47.994713 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-406d00ca-5a99-4ecb-9300-ff13bc77afe4 req-c1c33528-72b5-43c3-8836-68e5ea1d5c0b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039397 Jul 25 08:53:47.994713 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 445/856] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:53:48.617287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-27e44e0b-da60-4e9e-b24b-aab3a8bd2d2f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:48.617842 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-27e44e0b-da60-4e9e-b24b-aab3a8bd2d2f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:48.625071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-27e44e0b-da60-4e9e-b24b-aab3a8bd2d2f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:48.625521 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-27e44e0b-da60-4e9e-b24b-aab3a8bd2d2f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:48.626293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-27e44e0b-da60-4e9e-b24b-aab3a8bd2d2f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:48.626727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-27e44e0b-da60-4e9e-b24b-aab3a8bd2d2f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:48.761189 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-27e44e0b-da60-4e9e-b24b-aab3a8bd2d2f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:48.769031 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-27e44e0b-da60-4e9e-b24b-aab3a8bd2d2f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1366 microversion: 2.1 time: 0.156174 Jul 25 08:53:48.769604 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 412/857] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:48 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:49.788220 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:49.788932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:49.793199 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9d9014c3-ed99-4eff-8bee-a2540c86afce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:49.793898 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9d9014c3-ed99-4eff-8bee-a2540c86afce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:49.801599 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d9014c3-ed99-4eff-8bee-a2540c86afce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:49.802051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d9014c3-ed99-4eff-8bee-a2540c86afce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:49.802828 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d9014c3-ed99-4eff-8bee-a2540c86afce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:49.803262 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d9014c3-ed99-4eff-8bee-a2540c86afce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:49.941446 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9d9014c3-ed99-4eff-8bee-a2540c86afce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:49.948948 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9d9014c3-ed99-4eff-8bee-a2540c86afce tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1366 microversion: 2.1 time: 0.162185 Jul 25 08:53:49.949525 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 446/858] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:49 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:50.970435 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7dc4bb35-76aa-4d85-bac6-a8e6c42aac94 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:50.971172 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7dc4bb35-76aa-4d85-bac6-a8e6c42aac94 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:50.973580 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=6 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:50.979940 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7dc4bb35-76aa-4d85-bac6-a8e6c42aac94 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:50.980427 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7dc4bb35-76aa-4d85-bac6-a8e6c42aac94 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:50.981284 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7dc4bb35-76aa-4d85-bac6-a8e6c42aac94 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:50.981716 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7dc4bb35-76aa-4d85-bac6-a8e6c42aac94 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:51.124360 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7dc4bb35-76aa-4d85-bac6-a8e6c42aac94 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:53:51.132160 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7dc4bb35-76aa-4d85-bac6-a8e6c42aac94 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1556 microversion: 2.1 time: 0.165524 Jul 25 08:53:51.132766 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 413/859] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:53:50 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:53:51.153657 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b868b3fc-6927-412c-b2a9-e5635873a505 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:53:51.154946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b868b3fc-6927-412c-b2a9-e5635873a505 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:53:51.162862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b868b3fc-6927-412c-b2a9-e5635873a505 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:51.163308 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b868b3fc-6927-412c-b2a9-e5635873a505 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:51.164089 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b868b3fc-6927-412c-b2a9-e5635873a505 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:51.164550 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b868b3fc-6927-412c-b2a9-e5635873a505 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:51.256372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b868b3fc-6927-412c-b2a9-e5635873a505 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107095 Jul 25 08:53:51.257067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 447/860] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Jul 25 08:53:51 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:53:52.263669 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-f07632d5-0f1b-466f-8428-3fbbefc6a506 req-2ec49e85-b1c4-4dbe-9085-c0c8cf8e8dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5c94565-b030-4cad-a705-425ace6d71ff", "tag": "62088a84-476c-4db4-baa2-473b1dbbc579"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:53:52.278795 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-f07632d5-0f1b-466f-8428-3fbbefc6a506 req-2ec49e85-b1c4-4dbe-9085-c0c8cf8e8dff service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:53:52.279462 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-f07632d5-0f1b-466f-8428-3fbbefc6a506 req-2ec49e85-b1c4-4dbe-9085-c0c8cf8e8dff service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:53:52.297987 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-f07632d5-0f1b-466f-8428-3fbbefc6a506 req-2ec49e85-b1c4-4dbe-9085-c0c8cf8e8dff service nova] Creating event network-changed:62088a84-476c-4db4-baa2-473b1dbbc579 for instance c5c94565-b030-4cad-a705-425ace6d71ff on hv-cinder-85084 Jul 25 08:53:52.304809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-f07632d5-0f1b-466f-8428-3fbbefc6a506 req-2ec49e85-b1c4-4dbe-9085-c0c8cf8e8dff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047116 Jul 25 08:53:52.306193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 414/861] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:54:29.125655 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=7 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:29.126402 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:29.339023 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-86f5c48f-2efc-4ec0-80ee-2bdea98ee761 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:29.339461 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-86f5c48f-2efc-4ec0-80ee-2bdea98ee761 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:29.349719 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86f5c48f-2efc-4ec0-80ee-2bdea98ee761 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:29.349719 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86f5c48f-2efc-4ec0-80ee-2bdea98ee761 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:29.349719 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86f5c48f-2efc-4ec0-80ee-2bdea98ee761 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:29.350130 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86f5c48f-2efc-4ec0-80ee-2bdea98ee761 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:29.392089 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-86f5c48f-2efc-4ec0-80ee-2bdea98ee761 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments/b92dc107-841b-497f-8900-2864ca624b25" status: 200 len: 194 microversion: 2.20 time: 0.273735 Jul 25 08:54:29.393347 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 448/862] 10.222.0.52 () {60 vars in 1454 bytes} [Mon Jul 25 08:54:29 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments/b92dc107-841b-497f-8900-2864ca624b25 => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:54:29.467550 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:29.468652 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=43 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:29.474346 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1155ac6a-b2cc-4cbe-b929-eb94d72c3dc1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:29.474951 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1155ac6a-b2cc-4cbe-b929-eb94d72c3dc1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:29.482966 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1155ac6a-b2cc-4cbe-b929-eb94d72c3dc1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:29.483419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1155ac6a-b2cc-4cbe-b929-eb94d72c3dc1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:29.484198 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1155ac6a-b2cc-4cbe-b929-eb94d72c3dc1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:29.484664 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1155ac6a-b2cc-4cbe-b929-eb94d72c3dc1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:29.579601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.objects.instance [None req-1155ac6a-b2cc-4cbe-b929-eb94d72c3dc1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lazy-loading 'services' on Instance uuid 7b4a347c-82ac-48e1-a31e-45f7eb643cda {{(pid=124234) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:54:29.669868 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1155ac6a-b2cc-4cbe-b929-eb94d72c3dc1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments/b92dc107-841b-497f-8900-2864ca624b25" status: 202 len: 0 microversion: 2.20 time: 0.203923 Jul 25 08:54:29.670472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 415/863] 10.222.0.52 () {60 vars in 1457 bytes} [Mon Jul 25 08:54:29 2022] DELETE /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments/b92dc107-841b-497f-8900-2864ca624b25 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:54:29.679561 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cf2426fb-f1d4-41b8-8e36-72332ee97ada tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:29.682838 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cf2426fb-f1d4-41b8-8e36-72332ee97ada tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:29.695120 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cf2426fb-f1d4-41b8-8e36-72332ee97ada tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:29.695716 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cf2426fb-f1d4-41b8-8e36-72332ee97ada tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:29.696733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cf2426fb-f1d4-41b8-8e36-72332ee97ada tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:29.697455 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cf2426fb-f1d4-41b8-8e36-72332ee97ada tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:29.731500 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cf2426fb-f1d4-41b8-8e36-72332ee97ada tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056302 Jul 25 08:54:29.732164 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 449/864] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Jul 25 08:54:29 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:54:30.745122 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f13d528e-5c66-4e9a-a0f6-0577c0de7e97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:30.747809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f13d528e-5c66-4e9a-a0f6-0577c0de7e97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:30.754919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f13d528e-5c66-4e9a-a0f6-0577c0de7e97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:30.755374 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f13d528e-5c66-4e9a-a0f6-0577c0de7e97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:30.756149 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f13d528e-5c66-4e9a-a0f6-0577c0de7e97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:30.756605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f13d528e-5c66-4e9a-a0f6-0577c0de7e97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:30.799378 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f13d528e-5c66-4e9a-a0f6-0577c0de7e97 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058564 Jul 25 08:54:30.800022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 416/865] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Jul 25 08:54:30 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:54:31.190105 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f1a25c1d-df74-49a6-ab55-eecff905576a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:31.192308 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f1a25c1d-df74-49a6-ab55-eecff905576a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:31.200132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f1a25c1d-df74-49a6-ab55-eecff905576a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:31.200687 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f1a25c1d-df74-49a6-ab55-eecff905576a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:31.201602 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f1a25c1d-df74-49a6-ab55-eecff905576a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:31.202150 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f1a25c1d-df74-49a6-ab55-eecff905576a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:31.236009 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f1a25c1d-df74-49a6-ab55-eecff905576a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050218 Jul 25 08:54:31.236633 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 450/866] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:54:31 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:54:31.310180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-727d7466-1a86-48bb-9e19-4b11371cf1e1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:31.310742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-727d7466-1a86-48bb-9e19-4b11371cf1e1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:31.321010 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-727d7466-1a86-48bb-9e19-4b11371cf1e1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:31.321458 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-727d7466-1a86-48bb-9e19-4b11371cf1e1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:31.322234 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-727d7466-1a86-48bb-9e19-4b11371cf1e1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:31.322665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-727d7466-1a86-48bb-9e19-4b11371cf1e1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:31.353908 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-727d7466-1a86-48bb-9e19-4b11371cf1e1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:54:31.443063 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-727d7466-1a86-48bb-9e19-4b11371cf1e1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 204 len: 0 microversion: 2.1 time: 0.137182 Jul 25 08:54:31.443891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 417/867] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:54:31 2022] DELETE /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:54:31.452135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0c232459-d790-4264-8fcd-e0e9c36284fe tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:31.452785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0c232459-d790-4264-8fcd-e0e9c36284fe tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:31.459391 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0c232459-d790-4264-8fcd-e0e9c36284fe tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:31.459841 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0c232459-d790-4264-8fcd-e0e9c36284fe tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:31.460622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0c232459-d790-4264-8fcd-e0e9c36284fe tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:31.461051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0c232459-d790-4264-8fcd-e0e9c36284fe tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:31.624549 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0c232459-d790-4264-8fcd-e0e9c36284fe tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:31.633185 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0c232459-d790-4264-8fcd-e0e9c36284fe tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1676 microversion: 2.1 time: 0.184686 Jul 25 08:54:31.633793 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 451/868] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:31 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:31.815608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ea1c95ba-413d-4e5b-a9e7-c498f6c5f57d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:31.818386 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ea1c95ba-413d-4e5b-a9e7-c498f6c5f57d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:31.825898 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ea1c95ba-413d-4e5b-a9e7-c498f6c5f57d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:31.826351 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ea1c95ba-413d-4e5b-a9e7-c498f6c5f57d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:31.827119 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ea1c95ba-413d-4e5b-a9e7-c498f6c5f57d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:31.827550 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ea1c95ba-413d-4e5b-a9e7-c498f6c5f57d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:31.859897 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ea1c95ba-413d-4e5b-a9e7-c498f6c5f57d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049210 Jul 25 08:54:31.860467 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 418/869] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Jul 25 08:54:31 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:31.933322 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8b7a12d3-55b3-4801-a9c7-15de1e7a59eb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:31.933827 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8b7a12d3-55b3-4801-a9c7-15de1e7a59eb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:31.941148 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b7a12d3-55b3-4801-a9c7-15de1e7a59eb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:31.941608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b7a12d3-55b3-4801-a9c7-15de1e7a59eb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:31.942393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b7a12d3-55b3-4801-a9c7-15de1e7a59eb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:31.942839 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b7a12d3-55b3-4801-a9c7-15de1e7a59eb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:31.977981 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8b7a12d3-55b3-4801-a9c7-15de1e7a59eb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:54:32.070450 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8b7a12d3-55b3-4801-a9c7-15de1e7a59eb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 204 len: 0 microversion: 2.20 time: 0.140280 Jul 25 08:54:32.071441 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 452/870] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Jul 25 08:54:31 2022] DELETE /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 08:54:32.084172 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ad659d25-ed0f-422f-b274-eb951492e0f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:32.084969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ad659d25-ed0f-422f-b274-eb951492e0f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:32.093467 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad659d25-ed0f-422f-b274-eb951492e0f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:32.093815 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad659d25-ed0f-422f-b274-eb951492e0f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:32.094600 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad659d25-ed0f-422f-b274-eb951492e0f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:32.095043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad659d25-ed0f-422f-b274-eb951492e0f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:32.248017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ad659d25-ed0f-422f-b274-eb951492e0f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:32.256967 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ad659d25-ed0f-422f-b274-eb951492e0f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:32.258655 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ad659d25-ed0f-422f-b274-eb951492e0f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:32.259867 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ad659d25-ed0f-422f-b274-eb951492e0f0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.183450 Jul 25 08:54:32.260433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 419/871] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:32 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:32.655900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-002a2dd2-1c57-4581-943f-8d31a2206e20 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:32.656613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-002a2dd2-1c57-4581-943f-8d31a2206e20 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:32.664021 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-002a2dd2-1c57-4581-943f-8d31a2206e20 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:32.664812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-002a2dd2-1c57-4581-943f-8d31a2206e20 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:32.665624 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-002a2dd2-1c57-4581-943f-8d31a2206e20 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:32.666069 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-002a2dd2-1c57-4581-943f-8d31a2206e20 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:32.821379 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-002a2dd2-1c57-4581-943f-8d31a2206e20 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:32.829978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-002a2dd2-1c57-4581-943f-8d31a2206e20 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1676 microversion: 2.1 time: 0.178277 Jul 25 08:54:32.831051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 453/872] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:32 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:33.284073 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b5f6a72c-0af8-4e96-be67-6292d4aa770e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:33.284859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b5f6a72c-0af8-4e96-be67-6292d4aa770e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:33.292216 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5f6a72c-0af8-4e96-be67-6292d4aa770e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:33.292693 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5f6a72c-0af8-4e96-be67-6292d4aa770e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:33.293478 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5f6a72c-0af8-4e96-be67-6292d4aa770e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:33.293913 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b5f6a72c-0af8-4e96-be67-6292d4aa770e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:33.445661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b5f6a72c-0af8-4e96-be67-6292d4aa770e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:33.454152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b5f6a72c-0af8-4e96-be67-6292d4aa770e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:33.455733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b5f6a72c-0af8-4e96-be67-6292d4aa770e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:33.457006 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b5f6a72c-0af8-4e96-be67-6292d4aa770e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.177195 Jul 25 08:54:33.457564 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 420/873] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:33 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:33.852481 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f041d2dd-d8bc-4a2a-a725-e0969744b4c6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:33.853130 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f041d2dd-d8bc-4a2a-a725-e0969744b4c6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:33.859801 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f041d2dd-d8bc-4a2a-a725-e0969744b4c6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:33.860248 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f041d2dd-d8bc-4a2a-a725-e0969744b4c6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:33.861129 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f041d2dd-d8bc-4a2a-a725-e0969744b4c6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:33.862081 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f041d2dd-d8bc-4a2a-a725-e0969744b4c6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:34.018211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f041d2dd-d8bc-4a2a-a725-e0969744b4c6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:34.026834 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f041d2dd-d8bc-4a2a-a725-e0969744b4c6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1676 microversion: 2.1 time: 0.178403 Jul 25 08:54:34.027408 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 454/874] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:33 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:34.481617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dd814c56-be49-4884-8b67-9740781f2929 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:34.482865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dd814c56-be49-4884-8b67-9740781f2929 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:34.489646 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dd814c56-be49-4884-8b67-9740781f2929 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:34.490155 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dd814c56-be49-4884-8b67-9740781f2929 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:34.491045 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dd814c56-be49-4884-8b67-9740781f2929 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:34.491547 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dd814c56-be49-4884-8b67-9740781f2929 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:34.651193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dd814c56-be49-4884-8b67-9740781f2929 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:34.666709 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dd814c56-be49-4884-8b67-9740781f2929 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:34.670303 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dd814c56-be49-4884-8b67-9740781f2929 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:34.671621 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dd814c56-be49-4884-8b67-9740781f2929 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.194938 Jul 25 08:54:34.672254 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 421/875] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:34 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:54:35.051655 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6cae4f9a-8168-4422-befa-4876b2d33bf9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:35.052283 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6cae4f9a-8168-4422-befa-4876b2d33bf9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:35.059486 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6cae4f9a-8168-4422-befa-4876b2d33bf9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:35.060266 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6cae4f9a-8168-4422-befa-4876b2d33bf9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:35.061100 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6cae4f9a-8168-4422-befa-4876b2d33bf9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:35.061565 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6cae4f9a-8168-4422-befa-4876b2d33bf9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:35.140373 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6cae4f9a-8168-4422-befa-4876b2d33bf9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:35.152183 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6cae4f9a-8168-4422-befa-4876b2d33bf9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1608 microversion: 2.1 time: 0.105191 Jul 25 08:54:35.152837 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 455/876] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:35 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1608 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:35.576349 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4dea745d-ec7e-48fb-8062-a46de8cd88eb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1636106966"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:35.576933 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4dea745d-ec7e-48fb-8062-a46de8cd88eb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:35.585311 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4dea745d-ec7e-48fb-8062-a46de8cd88eb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:35.585742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4dea745d-ec7e-48fb-8062-a46de8cd88eb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:35.586649 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4dea745d-ec7e-48fb-8062-a46de8cd88eb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:35.587115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4dea745d-ec7e-48fb-8062-a46de8cd88eb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:35.699907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1dc1d91e-5168-43d0-b58e-91338e955814 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:35.700660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1dc1d91e-5168-43d0-b58e-91338e955814 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:35.711688 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1dc1d91e-5168-43d0-b58e-91338e955814 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:35.712403 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1dc1d91e-5168-43d0-b58e-91338e955814 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:35.713725 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1dc1d91e-5168-43d0-b58e-91338e955814 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:35.714700 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1dc1d91e-5168-43d0-b58e-91338e955814 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:35.759995 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.network.security_group_api [None req-4dea745d-ec7e-48fb-8062-a46de8cd88eb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Removing security group 80e09a9e-a28f-497d-b870-d7b93bada320 from port c243097a-4313-4fd5-ad41-f6f18a03b006 Jul 25 08:54:36.072884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1dc1d91e-5168-43d0-b58e-91338e955814 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:36.096527 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1dc1d91e-5168-43d0-b58e-91338e955814 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:36.109425 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1dc1d91e-5168-43d0-b58e-91338e955814 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:36.111126 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1dc1d91e-5168-43d0-b58e-91338e955814 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1725 microversion: 2.20 time: 0.418494 Jul 25 08:54:36.111997 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 456/877] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:35 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1725 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:36.124516 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-5ffda7d9-39a8-4e99-b7d9-062ee9b49e37 req-f3f09681-7030-41b7-8ef1-03062f1ccf97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7", "name": "network-vif-deleted", "tag": "de1515d4-bcfe-41ca-b713-85a3e00f3b9f"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:36.156044 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-5ffda7d9-39a8-4e99-b7d9-062ee9b49e37 req-f3f09681-7030-41b7-8ef1-03062f1ccf97 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:36.156848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-5ffda7d9-39a8-4e99-b7d9-062ee9b49e37 req-f3f09681-7030-41b7-8ef1-03062f1ccf97 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:36.184870 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-5ffda7d9-39a8-4e99-b7d9-062ee9b49e37 req-f3f09681-7030-41b7-8ef1-03062f1ccf97 service nova] Creating event network-vif-deleted:de1515d4-bcfe-41ca-b713-85a3e00f3b9f for instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 on hv-cinder-85084 Jul 25 08:54:36.198721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-5ffda7d9-39a8-4e99-b7d9-062ee9b49e37 req-f3f09681-7030-41b7-8ef1-03062f1ccf97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081100 Jul 25 08:54:36.202239 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 457/878] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:54:36.209587 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:36.211317 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:36.224463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:36.225552 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:36.227172 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:36.227855 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:36.285751 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:36.286501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:36.287234 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lazy-loading 'fault' on Instance uuid c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:54:36.352917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:36.363611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c95af831-59d0-428c-aea2-944ce34101e6 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 200 len: 1328 microversion: 2.1 time: 0.159275 Jul 25 08:54:36.370392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 458/879] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:36 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 1328 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:36.594660 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4dea745d-ec7e-48fb-8062-a46de8cd88eb tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "POST /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/action" status: 202 len: 0 microversion: 2.1 time: 1.202548 Jul 25 08:54:36.597327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 422/880] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 08:54:35 2022] POST /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/action => generated 0 bytes in 1206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:54:36.727560 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-1275dbee-c6cc-4a80-96aa-5f2791a2a0be req-33111357-0231-416d-8544-6e5a6fc10218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d74c6940-419a-4a70-bc74-9e4536cf9805", "tag": "c243097a-4313-4fd5-ad41-f6f18a03b006"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:36.764500 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1275dbee-c6cc-4a80-96aa-5f2791a2a0be req-33111357-0231-416d-8544-6e5a6fc10218 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:36.764815 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1275dbee-c6cc-4a80-96aa-5f2791a2a0be req-33111357-0231-416d-8544-6e5a6fc10218 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:36.795142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-1275dbee-c6cc-4a80-96aa-5f2791a2a0be req-33111357-0231-416d-8544-6e5a6fc10218 service nova] Creating event network-changed:c243097a-4313-4fd5-ad41-f6f18a03b006 for instance d74c6940-419a-4a70-bc74-9e4536cf9805 on hv-cinder-85084 Jul 25 08:54:36.806528 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-1275dbee-c6cc-4a80-96aa-5f2791a2a0be req-33111357-0231-416d-8544-6e5a6fc10218 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199642 Jul 25 08:54:36.812463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 459/881] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:54:37.139097 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-947ed628-fb11-4a9d-96dc-5fa2992073bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:37.139717 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-947ed628-fb11-4a9d-96dc-5fa2992073bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:37.157043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-947ed628-fb11-4a9d-96dc-5fa2992073bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:37.157514 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-947ed628-fb11-4a9d-96dc-5fa2992073bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:37.159002 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-947ed628-fb11-4a9d-96dc-5fa2992073bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:37.159459 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-947ed628-fb11-4a9d-96dc-5fa2992073bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:37.287118 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-947ed628-fb11-4a9d-96dc-5fa2992073bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:37.305740 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-947ed628-fb11-4a9d-96dc-5fa2992073bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:37.307379 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-947ed628-fb11-4a9d-96dc-5fa2992073bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:37.313349 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-947ed628-fb11-4a9d-96dc-5fa2992073bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 200 len: 1367 microversion: 2.20 time: 0.178387 Jul 25 08:54:37.320980 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 423/882] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:37 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:54:37.400821 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2a08663c-6964-47b7-9b8a-9e2902e282a7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:37.402192 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2a08663c-6964-47b7-9b8a-9e2902e282a7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:37.410846 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2a08663c-6964-47b7-9b8a-9e2902e282a7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:37.413225 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2a08663c-6964-47b7-9b8a-9e2902e282a7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:37.415067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2a08663c-6964-47b7-9b8a-9e2902e282a7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:37.415916 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2a08663c-6964-47b7-9b8a-9e2902e282a7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:37.432141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-2a08663c-6964-47b7-9b8a-9e2902e282a7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] HTTP exception thrown: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2a08663c-6964-47b7-9b8a-9e2902e282a7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Request method failure captured: Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 HTTP/1.1 Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhAad7eCfEu2Bu7qVsSTeoTEvi_lNRONzSSbzxsjeFcrmg9WeZQEqit9vbLBGyU0mS1VrJ5YXp_dKmheyat1SCH2bu5lSNt6It9v08o32oiqsolToR8oxlZ3XQjtpRgWkdNdXCaJqsj2oXu4k3s8kQ5tx6A_zn65KKK6GVWtuYvlSs Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:54:37.435045 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9313fe06660f4049be47f901c3fc6f76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}] Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 718ca333456f4de5b98f191ab40cca0b Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:54:37.436791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': 'c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7'} Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:54:37.437755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:54:37.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:54:37.442193 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2a08663c-6964-47b7-9b8a-9e2902e282a7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Returning 404 to user: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:54:37.443243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2a08663c-6964-47b7-9b8a-9e2902e282a7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 404 len: 111 microversion: 2.1 time: 0.047323 Jul 25 08:54:37.444501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 460/883] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:37 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:54:37.461619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-93003e9a-acdd-4068-ab0f-b5163c5b17a0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '.version_select at 0x7f0f798513a0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:37.505162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-93003e9a-acdd-4068-ab0f-b5163c5b17a0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022515460" status: 202 len: 0 microversion: 2.1 time: 0.053267 Jul 25 08:54:37.506374 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 424/884] 10.222.0.52 () {58 vars in 1221 bytes} [Mon Jul 25 08:54:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022515460 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:54:38.296417 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-faf43bb1-7bb2-4797-9cb4-f241a97021e6 req-b2674b02-36d5-4eab-98c4-ac8e60bc29c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4a347c-82ac-48e1-a31e-45f7eb643cda", "name": "network-vif-deleted", "tag": "8fcdc018-b6d0-4c78-ac99-e89933f5caf7"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:38.318310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-faf43bb1-7bb2-4797-9cb4-f241a97021e6 req-b2674b02-36d5-4eab-98c4-ac8e60bc29c6 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:38.319072 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-faf43bb1-7bb2-4797-9cb4-f241a97021e6 req-b2674b02-36d5-4eab-98c4-ac8e60bc29c6 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:38.339464 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6476d83f-d130-4958-8f0f-a7f75040d36a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:38.340254 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-6476d83f-d130-4958-8f0f-a7f75040d36a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:38.344971 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-faf43bb1-7bb2-4797-9cb4-f241a97021e6 req-b2674b02-36d5-4eab-98c4-ac8e60bc29c6 service nova] Creating event network-vif-deleted:8fcdc018-b6d0-4c78-ac99-e89933f5caf7 for instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda on hv-cinder-85084 Jul 25 08:54:38.351109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-faf43bb1-7bb2-4797-9cb4-f241a97021e6 req-b2674b02-36d5-4eab-98c4-ac8e60bc29c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058474 Jul 25 08:54:38.352385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 461/885] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:54:38.355036 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6476d83f-d130-4958-8f0f-a7f75040d36a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:38.355803 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6476d83f-d130-4958-8f0f-a7f75040d36a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:38.356828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6476d83f-d130-4958-8f0f-a7f75040d36a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:38.357430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-6476d83f-d130-4958-8f0f-a7f75040d36a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:38.377810 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-6476d83f-d130-4958-8f0f-a7f75040d36a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] HTTP exception thrown: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6476d83f-d130-4958-8f0f-a7f75040d36a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Request method failure captured: Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda HTTP/1.1 Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3ljXeGfpqo7VsdKdZFWk-ck-vjZvkTI9CRcLQ8SwqCZh0_Y3_JEP-2cjx4iPgyIE_spioJ3QFnioU5XpxqrDViGGWnPMwv4SJjGF9Pa_VlpZfquYbcLLCYOQxywXVxokFHY949BKpr5UUHPS7inOR31GZUYfdFwXm5OWxcGNQcNHoEU Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:54:38.379962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3491b85dc4543c88f500828b2df1d2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}] Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: d3f0b30685e94f83883d682731644a89 Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:54:38.381703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '7b4a347c-82ac-48e1-a31e-45f7eb643cda'} Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:54:38.382548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:54:38.383854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:54:38.386611 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6476d83f-d130-4958-8f0f-a7f75040d36a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Returning 404 to user: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:54:38.387711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6476d83f-d130-4958-8f0f-a7f75040d36a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 404 len: 111 microversion: 2.20 time: 0.052910 Jul 25 08:54:38.388656 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 425/886] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:38 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 08:54:38.399204 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-99d25771-5b8b-4ae2-b817-815bfe8ea893 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '.version_select at 0x7f0f799f18b0>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:38.426856 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-99d25771-5b8b-4ae2-b817-815bfe8ea893 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962024034" status: 204 len: 0 microversion: 2.20 time: 0.032220 Jul 25 08:54:38.427530 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 462/887] 10.222.0.52 () {60 vars in 1262 bytes} [Mon Jul 25 08:54:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962024034 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 08:54:38.821124 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-630adb9d-2cf2-481f-8480-fc643fb2062c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'create', calling method: .version_select at 0x7f0f7982adc0>, body: {"keypair": {"name": "tempest-keypair-2065406991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwOm3349zz66i62m8FAD1YaQnhrLsJi0BUQ4YjET8Pc68Mfgv/pQG/j5Mqnq7GIs7M2gfiRqqQpo8hT/77v56+UU7HZpbm3Tn8yuAzb6PBZuG2iKOmRaykJfOt7ToIT1A=="}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:38.848955 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-630adb9d-2cf2-481f-8480-fc643fb2062c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Getting quotas for project 9313fe06660f4049be47f901c3fc6f76. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:54:38.854582 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-630adb9d-2cf2-481f-8480-fc643fb2062c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Getting quotas for user 718ca333456f4de5b98f191ab40cca0b and project 9313fe06660f4049be47f901c3fc6f76. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:54:38.899367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-630adb9d-2cf2-481f-8480-fc643fb2062c tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081339 Jul 25 08:54:38.910647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 426/888] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Jul 25 08:54:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:54:39.067070 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-55b343c8-22f1-4b0e-aa22-92494e730eae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:39.068164 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-55b343c8-22f1-4b0e-aa22-92494e730eae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:39.075502 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-55b343c8-22f1-4b0e-aa22-92494e730eae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:39.076177 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-55b343c8-22f1-4b0e-aa22-92494e730eae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:39.077136 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-55b343c8-22f1-4b0e-aa22-92494e730eae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:39.077989 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-55b343c8-22f1-4b0e-aa22-92494e730eae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:39.193621 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-55b343c8-22f1-4b0e-aa22-92494e730eae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lazy-loading 'services' on Instance uuid d74c6940-419a-4a70-bc74-9e4536cf9805 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:54:39.311863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-55b343c8-22f1-4b0e-aa22-92494e730eae tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments/2841bde6-c267-42c4-8321-4433aa81b28e" status: 202 len: 0 microversion: 2.1 time: 0.249592 Jul 25 08:54:39.323411 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a50004e9-604e-4dc2-a68f-c614cb9818f0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:39.326147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a50004e9-604e-4dc2-a68f-c614cb9818f0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:39.328321 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 463/889] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:54:39 2022] DELETE /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments/2841bde6-c267-42c4-8321-4433aa81b28e => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:54:39.333890 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a50004e9-604e-4dc2-a68f-c614cb9818f0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:39.334613 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a50004e9-604e-4dc2-a68f-c614cb9818f0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:39.335632 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a50004e9-604e-4dc2-a68f-c614cb9818f0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:39.336250 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a50004e9-604e-4dc2-a68f-c614cb9818f0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:39.386099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a50004e9-604e-4dc2-a68f-c614cb9818f0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067196 Jul 25 08:54:39.389146 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 427/890] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:54:39 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:54:39.490145 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aa966cff-e52c-47ae-b1c0-c686e3bddc42 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Action: 'create', calling method: .version_select at 0x7f0f799700d0>, body: {"keypair": {"name": "tempest-keypair-1251652066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7a0laICyIGE/Ts9OUa3e275MiUUUNZuA0759ikFoiw3NXV6W9ReO0i4I2EGD906O4YTryzSR4Em73CqxzbAshoPbbkmbnn6LBJa3/yNP9wGdhx31xdbFAXwCJ3t5m7bQ=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:39.511188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-aa966cff-e52c-47ae-b1c0-c686e3bddc42 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Getting quotas for project f3491b85dc4543c88f500828b2df1d2d. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:54:39.519067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-aa966cff-e52c-47ae-b1c0-c686e3bddc42 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Getting quotas for user d3f0b30685e94f83883d682731644a89 and project f3491b85dc4543c88f500828b2df1d2d. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:54:39.545895 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-aa966cff-e52c-47ae-b1c0-c686e3bddc42 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.060886 Jul 25 08:54:39.546692 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 464/891] 10.222.0.52 () {62 vars in 1200 bytes} [Mon Jul 25 08:54:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 08:54:40.402561 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-30a6160f-9292-44e5-a191-d74095a3043e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:40.414027 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-02b0b5d5-cbf6-4d79-acb3-f8fd92119dfc req-c2ac7aa8-731c-4fd4-ac07-e5c1e4ea65bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d74c6940-419a-4a70-bc74-9e4536cf9805", "tag": "c243097a-4313-4fd5-ad41-f6f18a03b006"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:40.422043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-30a6160f-9292-44e5-a191-d74095a3043e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:40.452284 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-02b0b5d5-cbf6-4d79-acb3-f8fd92119dfc req-c2ac7aa8-731c-4fd4-ac07-e5c1e4ea65bc service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:40.454282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30a6160f-9292-44e5-a191-d74095a3043e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:40.454776 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30a6160f-9292-44e5-a191-d74095a3043e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:40.459230 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30a6160f-9292-44e5-a191-d74095a3043e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:40.460081 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-02b0b5d5-cbf6-4d79-acb3-f8fd92119dfc req-c2ac7aa8-731c-4fd4-ac07-e5c1e4ea65bc service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:40.460747 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30a6160f-9292-44e5-a191-d74095a3043e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:40.500559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-02b0b5d5-cbf6-4d79-acb3-f8fd92119dfc req-c2ac7aa8-731c-4fd4-ac07-e5c1e4ea65bc service nova] Creating event network-changed:c243097a-4313-4fd5-ad41-f6f18a03b006 for instance d74c6940-419a-4a70-bc74-9e4536cf9805 on hv-cinder-85084 Jul 25 08:54:40.513799 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-02b0b5d5-cbf6-4d79-acb3-f8fd92119dfc req-c2ac7aa8-731c-4fd4-ac07-e5c1e4ea65bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104481 Jul 25 08:54:40.515990 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 465/892] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:54:40.529986 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-30a6160f-9292-44e5-a191-d74095a3043e tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133257 Jul 25 08:54:40.543710 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5774b23c-6c27-46c3-aeec-dde2990ce06b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:40.544439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5774b23c-6c27-46c3-aeec-dde2990ce06b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:40.551252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 428/893] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:54:40 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:54:40.553593 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5774b23c-6c27-46c3-aeec-dde2990ce06b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:40.554051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5774b23c-6c27-46c3-aeec-dde2990ce06b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:40.554842 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5774b23c-6c27-46c3-aeec-dde2990ce06b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:40.555283 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5774b23c-6c27-46c3-aeec-dde2990ce06b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:40.641607 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-5774b23c-6c27-46c3-aeec-dde2990ce06b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] HTTP exception thrown: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 is not attached to volume 2841bde6-c267-42c4-8321-4433aa81b28e Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5774b23c-6c27-46c3-aeec-dde2990ce06b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Request method failure captured: Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: DELETE /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments/2841bde6-c267-42c4-8321-4433aa81b28e HTTP/1.1 Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3ljeceU0D1reteUTHVVDP06P_Wr7LXdn8ZDYcWX9zBcZjM3f-ubleah0_V3PGGg_ewHvU7WR03z81y2QsF3W9iYb4KjnReyAfYCcPRmuEkimlMo-NmubbO4WxlqdsVrXE0K40UpCBDiofSektzMKljHUQMULo24yvMYbaYXZCB-eKvo Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 3404b1a99987401183c8e3e851b382db Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-TestMinimumBasicScenario-1891398646 Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:54:40.652501 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3404b1a99987401183c8e3e851b382db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3404b1a99987401183c8e3e851b382db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3404b1a99987401183c8e3e851b382db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3404b1a99987401183c8e3e851b382db"}]}] Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-TestMinimumBasicScenario-1891398646 Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 3404b1a99987401183c8e3e851b382db Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1891398646 Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-TestMinimumBasicScenario-1891398646-project Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: cd036c73e5c84fa1ba548be4eae80804 Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-TestMinimumBasicScenario-1891398646-project Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:54:40.654201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 is not attached to volume 2841bde6-c267-42c4-8321-4433aa81b28e Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'server_id': 'd74c6940-419a-4a70-bc74-9e4536cf9805', 'id': '2841bde6-c267-42c4-8321-4433aa81b28e'} Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2841bde6-c267-42c4-8321-4433aa81b28e. Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:54:40.655090 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 is not attached to volume 2841bde6-c267-42c4-8321-4433aa81b28e Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 is not attached to volume 2841bde6-c267-42c4-8321-4433aa81b28e Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:54:40.658463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5774b23c-6c27-46c3-aeec-dde2990ce06b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Returning 404 to user: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 is not attached to volume 2841bde6-c267-42c4-8321-4433aa81b28e {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:54:40.660168 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5774b23c-6c27-46c3-aeec-dde2990ce06b tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments/2841bde6-c267-42c4-8321-4433aa81b28e" status: 404 len: 154 microversion: 2.1 time: 0.118710 Jul 25 08:54:40.660924 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 466/894] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:54:40 2022] DELETE /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805/os-volume_attachments/2841bde6-c267-42c4-8321-4433aa81b28e => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:54:40.827858 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1410309609", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3560e9df-9e9b-4cf9-8b14-5afa8bdd3245"}], "security_groups": [{"name": "tempest-securitygroup--504848972"}], "key_name": "tempest-keypair-2065406991", "user_data": "}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:40.961569 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.network.neutron [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] validate_networks() for [('3560e9df-9e9b-4cf9-8b14-5afa8bdd3245', None, None, None, None, None)] {{(pid=124234) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:54:41.419113 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Flavor limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:54:41.419632 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Image limits 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:54:41.420034 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Flavor pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:54:41.420452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Image pref 0:0:0 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:54:41.420913 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.virt.hardware [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124234) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:54:41.431305 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:41.431763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:41.432597 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:41.433058 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:41.454055 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Getting quotas for project 9313fe06660f4049be47f901c3fc6f76. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:54:41.459069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Getting quotas for user 718ca333456f4de5b98f191ab40cca0b and project 9313fe06660f4049be47f901c3fc6f76. Resources: {'instances', 'ram', 'cores'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:54:41.472078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Going to run 1 instances... {{(pid=124234) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:54:41.474409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124234) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:54:41.526086 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-76c0686c-f4d0-4fb7-8b9f-c77d952da563 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.706146 Jul 25 08:54:41.528004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 429/895] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:54:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:54:41.539592 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9039800b-1c1f-42c8-8df8-106ff9161ddf tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:41.540271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9039800b-1c1f-42c8-8df8-106ff9161ddf tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:41.611827 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9039800b-1c1f-42c8-8df8-106ff9161ddf tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:41.620111 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9039800b-1c1f-42c8-8df8-106ff9161ddf tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1238 microversion: 2.1 time: 0.084672 Jul 25 08:54:41.620783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 467/896] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:41 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:41.828415 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3aee6326-fd4e-4f3c-b8a8-ff10e8106511 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:41.829223 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3aee6326-fd4e-4f3c-b8a8-ff10e8106511 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:41.838174 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3aee6326-fd4e-4f3c-b8a8-ff10e8106511 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:41.838686 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3aee6326-fd4e-4f3c-b8a8-ff10e8106511 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:41.839496 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3aee6326-fd4e-4f3c-b8a8-ff10e8106511 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:41.840155 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3aee6326-fd4e-4f3c-b8a8-ff10e8106511 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:41.882850 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3aee6326-fd4e-4f3c-b8a8-ff10e8106511 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:54:41.953799 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-288673019", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81feca48-2aba-4dcd-848a-634aff6ea348"}], "security_groups": [{"name": "tempest-securitygroup--1032827132"}], "key_name": "tempest-keypair-1251652066", "user_data": "}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:41.987384 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3aee6326-fd4e-4f3c-b8a8-ff10e8106511 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 204 len: 0 microversion: 2.1 time: 0.162670 Jul 25 08:54:41.988709 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 430/897] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:54:41 2022] DELETE /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:54:42.007948 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c064e9bd-1421-44b3-91fd-e118ca96ec81 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:42.008681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c064e9bd-1421-44b3-91fd-e118ca96ec81 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:42.015036 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c064e9bd-1421-44b3-91fd-e118ca96ec81 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:42.015538 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c064e9bd-1421-44b3-91fd-e118ca96ec81 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:42.016742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c064e9bd-1421-44b3-91fd-e118ca96ec81 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:42.018131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c064e9bd-1421-44b3-91fd-e118ca96ec81 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:42.023070 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:42.108356 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] validate_networks() for [('81feca48-2aba-4dcd-848a-634aff6ea348', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:54:42.234856 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c064e9bd-1421-44b3-91fd-e118ca96ec81 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:42.243178 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c064e9bd-1421-44b3-91fd-e118ca96ec81 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1555 microversion: 2.1 time: 0.240369 Jul 25 08:54:42.243955 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 431/898] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:41 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:54:42.535884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:54:42.536303 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:54:42.536821 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:54:42.537230 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:54:42.537633 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:54:42.547141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:42.547967 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:42.548939 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:42.549372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:42.556366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:42.569939 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Getting quotas for project f3491b85dc4543c88f500828b2df1d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:54:42.574515 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Getting quotas for user d3f0b30685e94f83883d682731644a89 and project f3491b85dc4543c88f500828b2df1d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:54:42.586175 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:54:42.588441 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:54:42.638669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ac669116-19b3-42e4-908f-fbf578d0d760 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.694530 Jul 25 08:54:42.639584 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 468/899] 10.222.0.52 () {62 vars in 1188 bytes} [Mon Jul 25 08:54:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 08:54:42.647141 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e3af8052-1136-4239-9c57-3236a7bfb320 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:42.648278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e3af8052-1136-4239-9c57-3236a7bfb320 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:42.650329 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2e99abaf-b0a7-445b-af7f-15d1c537c713 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:42.650944 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2e99abaf-b0a7-445b-af7f-15d1c537c713 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:42.657501 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3af8052-1136-4239-9c57-3236a7bfb320 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:42.658904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3af8052-1136-4239-9c57-3236a7bfb320 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:42.660202 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3af8052-1136-4239-9c57-3236a7bfb320 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:42.660990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3af8052-1136-4239-9c57-3236a7bfb320 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:42.707900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2e99abaf-b0a7-445b-af7f-15d1c537c713 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:42.718517 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2e99abaf-b0a7-445b-af7f-15d1c537c713 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:42.720734 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2e99abaf-b0a7-445b-af7f-15d1c537c713 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:42.721863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2e99abaf-b0a7-445b-af7f-15d1c537c713 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1281 microversion: 2.20 time: 0.075377 Jul 25 08:54:42.722657 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 469/900] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:42 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:42.764295 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e3af8052-1136-4239-9c57-3236a7bfb320 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:42.772329 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e3af8052-1136-4239-9c57-3236a7bfb320 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1242 microversion: 2.1 time: 0.130746 Jul 25 08:54:42.772940 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 432/901] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:42 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:43.265468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1e731a3b-d17e-4e43-b1bd-f37a4eb7e2e6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:43.265989 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1e731a3b-d17e-4e43-b1bd-f37a4eb7e2e6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:43.274565 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1e731a3b-d17e-4e43-b1bd-f37a4eb7e2e6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:43.275055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1e731a3b-d17e-4e43-b1bd-f37a4eb7e2e6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:43.275864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1e731a3b-d17e-4e43-b1bd-f37a4eb7e2e6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:43.276421 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1e731a3b-d17e-4e43-b1bd-f37a4eb7e2e6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:43.414748 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1e731a3b-d17e-4e43-b1bd-f37a4eb7e2e6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:43.423519 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1e731a3b-d17e-4e43-b1bd-f37a4eb7e2e6 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1555 microversion: 2.1 time: 0.161742 Jul 25 08:54:43.424329 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 470/902] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:43 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:43.750230 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-be6cbc0f-59c9-4776-b8c8-561b8674c40f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:43.752954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-be6cbc0f-59c9-4776-b8c8-561b8674c40f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:43.764451 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-be6cbc0f-59c9-4776-b8c8-561b8674c40f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:43.765304 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-be6cbc0f-59c9-4776-b8c8-561b8674c40f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:43.766693 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-be6cbc0f-59c9-4776-b8c8-561b8674c40f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:43.767503 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-be6cbc0f-59c9-4776-b8c8-561b8674c40f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:43.793706 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a5d1f37d-32bf-4be9-a783-c3e705bf7c08 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:43.794533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a5d1f37d-32bf-4be9-a783-c3e705bf7c08 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:43.809268 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5d1f37d-32bf-4be9-a783-c3e705bf7c08 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:43.809984 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5d1f37d-32bf-4be9-a783-c3e705bf7c08 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:43.810971 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5d1f37d-32bf-4be9-a783-c3e705bf7c08 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:43.811582 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5d1f37d-32bf-4be9-a783-c3e705bf7c08 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:43.865179 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-be6cbc0f-59c9-4776-b8c8-561b8674c40f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:43.878573 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-be6cbc0f-59c9-4776-b8c8-561b8674c40f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:43.882119 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-be6cbc0f-59c9-4776-b8c8-561b8674c40f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:43.883869 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-be6cbc0f-59c9-4776-b8c8-561b8674c40f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1277 microversion: 2.20 time: 0.141607 Jul 25 08:54:43.885110 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 433/903] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:43 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:54:43.902649 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a5d1f37d-32bf-4be9-a783-c3e705bf7c08 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:43.910934 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a5d1f37d-32bf-4be9-a783-c3e705bf7c08 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1290 microversion: 2.1 time: 0.121544 Jul 25 08:54:43.911520 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 471/904] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:43 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1290 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:54:44.444952 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-11d80a18-7f00-4c58-91a6-d859bbf9ddf0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:44.445567 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-11d80a18-7f00-4c58-91a6-d859bbf9ddf0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:44.451710 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-11d80a18-7f00-4c58-91a6-d859bbf9ddf0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:44.452168 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-11d80a18-7f00-4c58-91a6-d859bbf9ddf0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:44.452965 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-11d80a18-7f00-4c58-91a6-d859bbf9ddf0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:44.453408 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-11d80a18-7f00-4c58-91a6-d859bbf9ddf0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:44.589277 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-11d80a18-7f00-4c58-91a6-d859bbf9ddf0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:44.598153 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-11d80a18-7f00-4c58-91a6-d859bbf9ddf0 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1555 microversion: 2.1 time: 0.157323 Jul 25 08:54:44.599847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 434/905] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:44 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:44.908431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-62d38abb-1cca-4140-b0dc-72ba86cd8da1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:44.909080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-62d38abb-1cca-4140-b0dc-72ba86cd8da1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:44.920394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-62d38abb-1cca-4140-b0dc-72ba86cd8da1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:44.920894 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-62d38abb-1cca-4140-b0dc-72ba86cd8da1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:44.921840 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-62d38abb-1cca-4140-b0dc-72ba86cd8da1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:44.922132 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-62d38abb-1cca-4140-b0dc-72ba86cd8da1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:44.936764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a5490fa7-7217-4a88-a51c-95b4df80a6f0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:44.937764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a5490fa7-7217-4a88-a51c-95b4df80a6f0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:44.947493 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5490fa7-7217-4a88-a51c-95b4df80a6f0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:44.949464 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5490fa7-7217-4a88-a51c-95b4df80a6f0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:44.950424 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5490fa7-7217-4a88-a51c-95b4df80a6f0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:44.950955 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a5490fa7-7217-4a88-a51c-95b4df80a6f0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:45.120718 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a5490fa7-7217-4a88-a51c-95b4df80a6f0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:45.131001 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a5490fa7-7217-4a88-a51c-95b4df80a6f0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1296 microversion: 2.1 time: 0.201301 Jul 25 08:54:45.132264 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 435/906] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:44 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1296 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:54:45.132389 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-62d38abb-1cca-4140-b0dc-72ba86cd8da1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:45.144028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-62d38abb-1cca-4140-b0dc-72ba86cd8da1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:45.147744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-62d38abb-1cca-4140-b0dc-72ba86cd8da1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:45.149400 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-62d38abb-1cca-4140-b0dc-72ba86cd8da1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1339 microversion: 2.20 time: 0.245898 Jul 25 08:54:45.150146 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 472/907] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:44 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1339 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:45.443114 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-23b9fa2e-c1b9-4d00-93d9-25fe5357e0c2 req-1106537b-97fc-4843-bc4c-96301e70bbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d74c6940-419a-4a70-bc74-9e4536cf9805", "name": "network-vif-deleted", "tag": "c243097a-4313-4fd5-ad41-f6f18a03b006"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:45.459568 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-23b9fa2e-c1b9-4d00-93d9-25fe5357e0c2 req-1106537b-97fc-4843-bc4c-96301e70bbdb service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:45.460290 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-23b9fa2e-c1b9-4d00-93d9-25fe5357e0c2 req-1106537b-97fc-4843-bc4c-96301e70bbdb service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:45.478049 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-23b9fa2e-c1b9-4d00-93d9-25fe5357e0c2 req-1106537b-97fc-4843-bc4c-96301e70bbdb service nova] Creating event network-vif-deleted:c243097a-4313-4fd5-ad41-f6f18a03b006 for instance d74c6940-419a-4a70-bc74-9e4536cf9805 on hv-cinder-85084 Jul 25 08:54:45.486517 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-23b9fa2e-c1b9-4d00-93d9-25fe5357e0c2 req-1106537b-97fc-4843-bc4c-96301e70bbdb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049012 Jul 25 08:54:45.487260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 436/908] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:54:45.620071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:45.620730 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:45.628409 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:45.629316 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:45.630342 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:45.630958 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:45.683561 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:45.684450 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:45.685075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lazy-loading 'fault' on Instance uuid d74c6940-419a-4a70-bc74-9e4536cf9805 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:54:45.787311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd036c73e5c84fa1ba548be4eae80804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3404b1a99987401183c8e3e851b382db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:45.803579 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-07e5f912-fd67-44d8-80a5-d2392b022499 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 200 len: 1349 microversion: 2.1 time: 0.186960 Jul 25 08:54:45.821525 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 473/909] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:45 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 1349 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:46.175664 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5a056d11-bd23-46d3-8f82-018105a1556e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:46.179766 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5a056d11-bd23-46d3-8f82-018105a1556e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:46.195682 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1401adac-3f8e-4e95-95a4-5d14e0d94061 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:46.202708 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1401adac-3f8e-4e95-95a4-5d14e0d94061 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:46.224732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5a056d11-bd23-46d3-8f82-018105a1556e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:46.228259 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5a056d11-bd23-46d3-8f82-018105a1556e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:46.230488 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5a056d11-bd23-46d3-8f82-018105a1556e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:46.232837 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1401adac-3f8e-4e95-95a4-5d14e0d94061 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:46.234228 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5a056d11-bd23-46d3-8f82-018105a1556e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:46.238140 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1401adac-3f8e-4e95-95a4-5d14e0d94061 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:46.240278 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1401adac-3f8e-4e95-95a4-5d14e0d94061 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:46.241451 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1401adac-3f8e-4e95-95a4-5d14e0d94061 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:46.792472 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1401adac-3f8e-4e95-95a4-5d14e0d94061 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:46.797276 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5a056d11-bd23-46d3-8f82-018105a1556e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:46.812907 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5a056d11-bd23-46d3-8f82-018105a1556e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.661430 Jul 25 08:54:46.813713 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 437/910] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:46 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:46.818026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1401adac-3f8e-4e95-95a4-5d14e0d94061 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:46.824827 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1401adac-3f8e-4e95-95a4-5d14e0d94061 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:46.827523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1401adac-3f8e-4e95-95a4-5d14e0d94061 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.642045 Jul 25 08:54:46.829760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 474/911] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:46 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:46.829991 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-76b4b0dd-2d28-4ed4-8fbb-8b2755f2ec8f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:46.830628 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-76b4b0dd-2d28-4ed4-8fbb-8b2755f2ec8f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] [instance: d74c6940-419a-4a70-bc74-9e4536cf9805] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:46.837404 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76b4b0dd-2d28-4ed4-8fbb-8b2755f2ec8f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:46.838192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76b4b0dd-2d28-4ed4-8fbb-8b2755f2ec8f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:46.839192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76b4b0dd-2d28-4ed4-8fbb-8b2755f2ec8f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:46.839840 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76b4b0dd-2d28-4ed4-8fbb-8b2755f2ec8f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:46.867100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-76b4b0dd-2d28-4ed4-8fbb-8b2755f2ec8f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] HTTP exception thrown: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 could not be found. Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-76b4b0dd-2d28-4ed4-8fbb-8b2755f2ec8f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Request method failure captured: Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 HTTP/1.1 Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3ljeceU0D1reteUTHVVDP06P_Wr7LXdn8ZDYcWX9zBcZjM3f-ubleah0_V3PGGg_ewHvU7WR03z81y2QsF3W9iYb4KjnReyAfYCcPRmuEkimlMo-NmubbO4WxlqdsVrXE0K40UpCBDiofSektzMKljHUQMULo24yvMYbaYXZCB-eKvo Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 3404b1a99987401183c8e3e851b382db Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-TestMinimumBasicScenario-1891398646 Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:54:46.868985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3404b1a99987401183c8e3e851b382db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3404b1a99987401183c8e3e851b382db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3404b1a99987401183c8e3e851b382db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3404b1a99987401183c8e3e851b382db"}]}] Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-TestMinimumBasicScenario-1891398646 Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 3404b1a99987401183c8e3e851b382db Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1891398646 Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-TestMinimumBasicScenario-1891398646-project Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: cd036c73e5c84fa1ba548be4eae80804 Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-TestMinimumBasicScenario-1891398646-project Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 could not be found. Jul 25 08:54:46.872164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'd74c6940-419a-4a70-bc74-9e4536cf9805'} Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 could not be found. Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:54:46.879152 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 could not be found. Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 could not be found. Jul 25 08:54:46.882019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:54:46.887332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-76b4b0dd-2d28-4ed4-8fbb-8b2755f2ec8f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Returning 404 to user: Instance d74c6940-419a-4a70-bc74-9e4536cf9805 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:54:46.887332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-76b4b0dd-2d28-4ed4-8fbb-8b2755f2ec8f tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805" status: 404 len: 111 microversion: 2.1 time: 0.048048 Jul 25 08:54:46.887332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 438/912] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:46 2022] GET /compute/v2.1/servers/d74c6940-419a-4a70-bc74-9e4536cf9805 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:54:46.895127 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-463e360c-9996-4adc-beb4-b6b2a8acc455 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] Calling method '.version_select at 0x7f0f799dd5e0>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:46.920094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:46.936071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-463e360c-9996-4adc-beb4-b6b2a8acc455 tempest-TestMinimumBasicScenario-1891398646 tempest-TestMinimumBasicScenario-1891398646-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1650024625" status: 202 len: 0 microversion: 2.1 time: 0.049668 Jul 25 08:54:46.939001 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 475/913] 10.222.0.52 () {58 vars in 1272 bytes} [Mon Jul 25 08:54:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1650024625 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:54:47.463463 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-ec617b69-1ab7-4dfd-80a5-7251483dfd92 req-41f509f8-156c-4a3e-83a6-a134a7411490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48872a7-8219-4458-8832-bc33f66c0250", "tag": "8d036e4d-eb5b-4629-9fa0-863090220d9c"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:47.480896 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-ec617b69-1ab7-4dfd-80a5-7251483dfd92 req-41f509f8-156c-4a3e-83a6-a134a7411490 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:47.480896 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-ec617b69-1ab7-4dfd-80a5-7251483dfd92 req-41f509f8-156c-4a3e-83a6-a134a7411490 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:47.498565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-ec617b69-1ab7-4dfd-80a5-7251483dfd92 req-41f509f8-156c-4a3e-83a6-a134a7411490 service nova] Creating event network-changed:8d036e4d-eb5b-4629-9fa0-863090220d9c for instance e48872a7-8219-4458-8832-bc33f66c0250 on hv-cinder-85084 Jul 25 08:54:47.505635 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-ec617b69-1ab7-4dfd-80a5-7251483dfd92 req-41f509f8-156c-4a3e-83a6-a134a7411490 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046093 Jul 25 08:54:47.506816 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 439/914] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:54:47.522285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-39f46855-9619-4446-924e-bafbf04487b4 req-47019178-3c8f-442b-b807-77f4ef6f0aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f22e6c-5c89-42ee-90ce-a87e77bfa17b", "tag": "68b8d737-1cd3-4135-ad4b-35b7ce49fc3d"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:47.564681 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-39f46855-9619-4446-924e-bafbf04487b4 req-47019178-3c8f-442b-b807-77f4ef6f0aac service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:47.565208 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-39f46855-9619-4446-924e-bafbf04487b4 req-47019178-3c8f-442b-b807-77f4ef6f0aac service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:47.584937 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-39f46855-9619-4446-924e-bafbf04487b4 req-47019178-3c8f-442b-b807-77f4ef6f0aac service nova] Creating event network-changed:68b8d737-1cd3-4135-ad4b-35b7ce49fc3d for instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b on hv-cinder-85084 Jul 25 08:54:47.598181 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-39f46855-9619-4446-924e-bafbf04487b4 req-47019178-3c8f-442b-b807-77f4ef6f0aac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079778 Jul 25 08:54:47.599273 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 476/915] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:54:47.838045 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-28979261-66b4-46e8-bd8c-50f3dff2f2d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:47.839046 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-28979261-66b4-46e8-bd8c-50f3dff2f2d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:47.854747 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-28979261-66b4-46e8-bd8c-50f3dff2f2d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:47.855586 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-28979261-66b4-46e8-bd8c-50f3dff2f2d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:47.856422 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-28979261-66b4-46e8-bd8c-50f3dff2f2d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:47.858094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a8eeea01-2c78-4f03-9dd0-843f3a3b8208 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:47.859097 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-28979261-66b4-46e8-bd8c-50f3dff2f2d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:47.862416 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a8eeea01-2c78-4f03-9dd0-843f3a3b8208 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:47.880859 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8eeea01-2c78-4f03-9dd0-843f3a3b8208 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:47.882176 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8eeea01-2c78-4f03-9dd0-843f3a3b8208 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:47.883726 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8eeea01-2c78-4f03-9dd0-843f3a3b8208 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:47.884684 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8eeea01-2c78-4f03-9dd0-843f3a3b8208 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:48.135525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-28979261-66b4-46e8-bd8c-50f3dff2f2d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:48.143487 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a8eeea01-2c78-4f03-9dd0-843f3a3b8208 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:48.144890 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-28979261-66b4-46e8-bd8c-50f3dff2f2d0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.312544 Jul 25 08:54:48.145498 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 440/916] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:47 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:48.161251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a8eeea01-2c78-4f03-9dd0-843f3a3b8208 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:48.164759 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a8eeea01-2c78-4f03-9dd0-843f3a3b8208 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:48.166799 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a8eeea01-2c78-4f03-9dd0-843f3a3b8208 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.318437 Jul 25 08:54:48.167785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 477/917] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:47 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:49.183672 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c8bd4025-b1b3-4dba-9735-6b384aefb24b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:49.185067 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c8bd4025-b1b3-4dba-9735-6b384aefb24b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:49.191237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e50f504a-9dee-43a0-8cc1-1982a2f30003 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:49.191862 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e50f504a-9dee-43a0-8cc1-1982a2f30003 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:49.193512 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8bd4025-b1b3-4dba-9735-6b384aefb24b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:49.193882 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8bd4025-b1b3-4dba-9735-6b384aefb24b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:49.194761 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8bd4025-b1b3-4dba-9735-6b384aefb24b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:49.195261 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8bd4025-b1b3-4dba-9735-6b384aefb24b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:49.204313 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e50f504a-9dee-43a0-8cc1-1982a2f30003 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:49.205172 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e50f504a-9dee-43a0-8cc1-1982a2f30003 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:49.206198 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e50f504a-9dee-43a0-8cc1-1982a2f30003 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:49.206811 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e50f504a-9dee-43a0-8cc1-1982a2f30003 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:49.426251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e50f504a-9dee-43a0-8cc1-1982a2f30003 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:49.434728 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e50f504a-9dee-43a0-8cc1-1982a2f30003 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:49.436346 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e50f504a-9dee-43a0-8cc1-1982a2f30003 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:49.437553 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e50f504a-9dee-43a0-8cc1-1982a2f30003 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.251071 Jul 25 08:54:49.438067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 478/918] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:49 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:54:49.438591 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c8bd4025-b1b3-4dba-9735-6b384aefb24b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:49.443315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8b8095d2-5c5f-4682-81fd-af8049c1d9e7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:49.443818 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8b8095d2-5c5f-4682-81fd-af8049c1d9e7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:49.449985 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b8095d2-5c5f-4682-81fd-af8049c1d9e7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:49.450276 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c8bd4025-b1b3-4dba-9735-6b384aefb24b tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.270685 Jul 25 08:54:49.450683 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b8095d2-5c5f-4682-81fd-af8049c1d9e7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:49.451647 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 441/919] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:49 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:49.452062 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b8095d2-5c5f-4682-81fd-af8049c1d9e7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:49.453438 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b8095d2-5c5f-4682-81fd-af8049c1d9e7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:49.536795 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-8b8095d2-5c5f-4682-81fd-af8049c1d9e7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lazy-loading 'services' on Instance uuid f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:54:49.615599 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8b8095d2-5c5f-4682-81fd-af8049c1d9e7 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments/c7b7aba6-924b-445f-a60c-53b02ca7e4f4" status: 202 len: 0 microversion: 2.1 time: 0.175989 Jul 25 08:54:49.616495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 479/920] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:54:49 2022] DELETE /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments/c7b7aba6-924b-445f-a60c-53b02ca7e4f4 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:54:49.625278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e8a87f12-5fb5-4e21-bdeb-62c5e0d4bacf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:49.627570 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e8a87f12-5fb5-4e21-bdeb-62c5e0d4bacf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:49.634391 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e8a87f12-5fb5-4e21-bdeb-62c5e0d4bacf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:49.634932 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e8a87f12-5fb5-4e21-bdeb-62c5e0d4bacf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:49.635715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e8a87f12-5fb5-4e21-bdeb-62c5e0d4bacf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:49.636149 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e8a87f12-5fb5-4e21-bdeb-62c5e0d4bacf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:49.670122 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e8a87f12-5fb5-4e21-bdeb-62c5e0d4bacf tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049068 Jul 25 08:54:49.670713 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 442/921] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:54:49 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:54:50.461698 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8230c609-c784-4911-ae8e-e5369e47f7e6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:50.463615 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8230c609-c784-4911-ae8e-e5369e47f7e6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:50.470889 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-99d54537-857d-4142-b9a5-2fbf8b41f858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:50.471526 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-99d54537-857d-4142-b9a5-2fbf8b41f858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:50.473172 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8230c609-c784-4911-ae8e-e5369e47f7e6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:50.473809 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8230c609-c784-4911-ae8e-e5369e47f7e6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:50.475214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8230c609-c784-4911-ae8e-e5369e47f7e6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:50.477024 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8230c609-c784-4911-ae8e-e5369e47f7e6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:50.479452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-99d54537-857d-4142-b9a5-2fbf8b41f858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:50.479908 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-99d54537-857d-4142-b9a5-2fbf8b41f858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:50.480727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-99d54537-857d-4142-b9a5-2fbf8b41f858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:50.481170 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-99d54537-857d-4142-b9a5-2fbf8b41f858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:50.763745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-99d54537-857d-4142-b9a5-2fbf8b41f858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:50.768985 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8230c609-c784-4911-ae8e-e5369e47f7e6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:50.778268 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8230c609-c784-4911-ae8e-e5369e47f7e6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:50.779366 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-99d54537-857d-4142-b9a5-2fbf8b41f858 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.312301 Jul 25 08:54:50.779910 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8230c609-c784-4911-ae8e-e5369e47f7e6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:50.781325 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8230c609-c784-4911-ae8e-e5369e47f7e6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.325308 Jul 25 08:54:50.793549 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 480/922] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:50 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:50.793549 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0b2a8bba-e57c-46c4-b3df-2acd46dcdbda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:50.793549 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0b2a8bba-e57c-46c4-b3df-2acd46dcdbda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:50.794011 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 443/923] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:50 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:50.799683 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b2a8bba-e57c-46c4-b3df-2acd46dcdbda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:50.800866 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b2a8bba-e57c-46c4-b3df-2acd46dcdbda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:50.801746 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b2a8bba-e57c-46c4-b3df-2acd46dcdbda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:50.802252 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0b2a8bba-e57c-46c4-b3df-2acd46dcdbda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:50.833119 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0b2a8bba-e57c-46c4-b3df-2acd46dcdbda tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048809 Jul 25 08:54:50.833618 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 481/924] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:54:50 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:54:51.799920 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-97cc813b-49c3-4152-bb17-1d5c26a57b4e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:51.800660 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-97cc813b-49c3-4152-bb17-1d5c26a57b4e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:51.802621 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:51.803653 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=10 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:51.806430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:51.811149 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-97cc813b-49c3-4152-bb17-1d5c26a57b4e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:51.811605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-97cc813b-49c3-4152-bb17-1d5c26a57b4e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:51.812404 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-97cc813b-49c3-4152-bb17-1d5c26a57b4e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:51.812862 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-97cc813b-49c3-4152-bb17-1d5c26a57b4e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:51.815700 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8c6164fb-9cd7-4420-9d7d-38bb5baa381e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:51.819933 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8c6164fb-9cd7-4420-9d7d-38bb5baa381e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:51.836363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c6164fb-9cd7-4420-9d7d-38bb5baa381e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:51.837212 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c6164fb-9cd7-4420-9d7d-38bb5baa381e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:51.841106 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c6164fb-9cd7-4420-9d7d-38bb5baa381e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:51.841852 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c6164fb-9cd7-4420-9d7d-38bb5baa381e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:52.077913 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-97cc813b-49c3-4152-bb17-1d5c26a57b4e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:52.082914 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-97cc813b-49c3-4152-bb17-1d5c26a57b4e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.286763 Jul 25 08:54:52.096222 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 444/925] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:51 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:52.101458 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-72ee278c-8978-44c1-8af0-efe6e4fe2dc8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:52.103820 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-72ee278c-8978-44c1-8af0-efe6e4fe2dc8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:52.111253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72ee278c-8978-44c1-8af0-efe6e4fe2dc8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:52.112099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72ee278c-8978-44c1-8af0-efe6e4fe2dc8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:52.113166 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72ee278c-8978-44c1-8af0-efe6e4fe2dc8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:52.113854 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72ee278c-8978-44c1-8af0-efe6e4fe2dc8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:52.120122 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8c6164fb-9cd7-4420-9d7d-38bb5baa381e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:52.130076 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8c6164fb-9cd7-4420-9d7d-38bb5baa381e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:52.131624 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8c6164fb-9cd7-4420-9d7d-38bb5baa381e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:52.132781 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8c6164fb-9cd7-4420-9d7d-38bb5baa381e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.326684 Jul 25 08:54:52.150078 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 482/926] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:51 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:52.155732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-72ee278c-8978-44c1-8af0-efe6e4fe2dc8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058047 Jul 25 08:54:52.156997 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 445/927] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:54:52 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:54:53.104053 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-13145fcd-e6fd-4396-9b18-9b5479300ba2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:53.104895 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-13145fcd-e6fd-4396-9b18-9b5479300ba2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:53.108482 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:53.109234 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=14 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:53.114001 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13145fcd-e6fd-4396-9b18-9b5479300ba2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:53.114457 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13145fcd-e6fd-4396-9b18-9b5479300ba2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:53.115245 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13145fcd-e6fd-4396-9b18-9b5479300ba2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:53.115684 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13145fcd-e6fd-4396-9b18-9b5479300ba2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:53.157417 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-eb802e38-4646-4714-bb21-bd45e7c39641 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:53.158707 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-eb802e38-4646-4714-bb21-bd45e7c39641 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:53.166671 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-eb802e38-4646-4714-bb21-bd45e7c39641 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:53.167432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-eb802e38-4646-4714-bb21-bd45e7c39641 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:53.168482 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-eb802e38-4646-4714-bb21-bd45e7c39641 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:53.169126 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-eb802e38-4646-4714-bb21-bd45e7c39641 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:53.402128 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-13145fcd-e6fd-4396-9b18-9b5479300ba2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:53.405097 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-eb802e38-4646-4714-bb21-bd45e7c39641 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:53.410798 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-13145fcd-e6fd-4396-9b18-9b5479300ba2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.310620 Jul 25 08:54:53.411642 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 483/928] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:53 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:53.413842 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-eb802e38-4646-4714-bb21-bd45e7c39641 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:53.415413 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-eb802e38-4646-4714-bb21-bd45e7c39641 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:53.416603 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-eb802e38-4646-4714-bb21-bd45e7c39641 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.264847 Jul 25 08:54:53.417154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-77c98f8a-bad2-4c40-a5a1-0d67b092bcb0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:53.419519 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-77c98f8a-bad2-4c40-a5a1-0d67b092bcb0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:53.427964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 446/929] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:53 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:53.428220 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77c98f8a-bad2-4c40-a5a1-0d67b092bcb0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:53.429716 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77c98f8a-bad2-4c40-a5a1-0d67b092bcb0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:53.430646 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77c98f8a-bad2-4c40-a5a1-0d67b092bcb0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:53.431145 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77c98f8a-bad2-4c40-a5a1-0d67b092bcb0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:53.464487 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-77c98f8a-bad2-4c40-a5a1-0d67b092bcb0 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051380 Jul 25 08:54:53.465211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 484/930] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:54:53 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:54:54.432928 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-911e13dc-4081-4b77-b8e9-641f75d680eb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:54.433895 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-911e13dc-4081-4b77-b8e9-641f75d680eb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:54.448016 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-911e13dc-4081-4b77-b8e9-641f75d680eb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:54.448688 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-911e13dc-4081-4b77-b8e9-641f75d680eb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:54.450062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-911e13dc-4081-4b77-b8e9-641f75d680eb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:54.451049 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-911e13dc-4081-4b77-b8e9-641f75d680eb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:54.502857 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-361f4914-4f2c-4c7b-8a25-94236160866e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:54.508062 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-361f4914-4f2c-4c7b-8a25-94236160866e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:54.526757 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-361f4914-4f2c-4c7b-8a25-94236160866e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:54.527385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-361f4914-4f2c-4c7b-8a25-94236160866e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:54.528160 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-361f4914-4f2c-4c7b-8a25-94236160866e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:54.528532 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-361f4914-4f2c-4c7b-8a25-94236160866e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:55.193018 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-361f4914-4f2c-4c7b-8a25-94236160866e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:55.204887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-361f4914-4f2c-4c7b-8a25-94236160866e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:55.206954 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-361f4914-4f2c-4c7b-8a25-94236160866e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:55.209962 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-361f4914-4f2c-4c7b-8a25-94236160866e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.743996 Jul 25 08:54:55.211475 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 485/931] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:54 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:55.214093 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-911e13dc-4081-4b77-b8e9-641f75d680eb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:55.216889 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b3deaf5d-f4df-4d94-a796-fdcfb7134e3e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:55.220272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b3deaf5d-f4df-4d94-a796-fdcfb7134e3e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:55.222616 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-911e13dc-4081-4b77-b8e9-641f75d680eb tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.793790 Jul 25 08:54:55.236823 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 447/932] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:54 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:55.236823 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-6537493e-ad86-43d6-8e70-ecd21c3e9e51 req-7df93714-328c-4a37-8895-02f60a3a18ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f22e6c-5c89-42ee-90ce-a87e77bfa17b", "name": "network-vif-plugged", "status": "completed", "tag": "68b8d737-1cd3-4135-ad4b-35b7ce49fc3d"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:55.241950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b3deaf5d-f4df-4d94-a796-fdcfb7134e3e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:55.243464 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b3deaf5d-f4df-4d94-a796-fdcfb7134e3e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:55.244612 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b3deaf5d-f4df-4d94-a796-fdcfb7134e3e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:55.245022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-6537493e-ad86-43d6-8e70-ecd21c3e9e51 req-7df93714-328c-4a37-8895-02f60a3a18ac service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:55.245153 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b3deaf5d-f4df-4d94-a796-fdcfb7134e3e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:55.245710 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-6537493e-ad86-43d6-8e70-ecd21c3e9e51 req-7df93714-328c-4a37-8895-02f60a3a18ac service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:55.258584 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-6537493e-ad86-43d6-8e70-ecd21c3e9e51 req-7df93714-328c-4a37-8895-02f60a3a18ac service nova] Creating event network-vif-plugged:68b8d737-1cd3-4135-ad4b-35b7ce49fc3d for instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b on hv-cinder-85084 Jul 25 08:54:55.263929 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-6537493e-ad86-43d6-8e70-ecd21c3e9e51 req-7df93714-328c-4a37-8895-02f60a3a18ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038037 Jul 25 08:54:55.264664 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 448/933] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:54:55.277892 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b3deaf5d-f4df-4d94-a796-fdcfb7134e3e tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065152 Jul 25 08:54:55.278662 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 486/934] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:54:55 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:54:55.370199 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ad86fe0f-068f-46c4-af9b-e20f4d5421aa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:55.370790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ad86fe0f-068f-46c4-af9b-e20f4d5421aa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:55.378194 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad86fe0f-068f-46c4-af9b-e20f4d5421aa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:55.378930 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad86fe0f-068f-46c4-af9b-e20f4d5421aa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:55.379958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad86fe0f-068f-46c4-af9b-e20f4d5421aa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:55.380596 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ad86fe0f-068f-46c4-af9b-e20f4d5421aa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:55.410633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ad86fe0f-068f-46c4-af9b-e20f4d5421aa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:54:55.449784 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=100 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:55.519726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ad86fe0f-068f-46c4-af9b-e20f4d5421aa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 204 len: 0 microversion: 2.1 time: 0.153394 Jul 25 08:54:55.524608 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 449/935] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:54:55 2022] DELETE /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:54:55.529467 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-23bb094e-713b-4f48-b007-4be8a0e189b6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:55.530703 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-23bb094e-713b-4f48-b007-4be8a0e189b6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:55.546087 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23bb094e-713b-4f48-b007-4be8a0e189b6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:55.546908 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23bb094e-713b-4f48-b007-4be8a0e189b6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:55.548156 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23bb094e-713b-4f48-b007-4be8a0e189b6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:55.548824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23bb094e-713b-4f48-b007-4be8a0e189b6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:55.553938 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:55.721137 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-23bb094e-713b-4f48-b007-4be8a0e189b6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:55.728704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-23bb094e-713b-4f48-b007-4be8a0e189b6 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1691 microversion: 2.1 time: 0.202916 Jul 25 08:54:55.729286 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 487/936] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:55 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1691 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:54:56.236967 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a4226546-9723-488a-8022-50bea9390556 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:56.237861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a4226546-9723-488a-8022-50bea9390556 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:56.246626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fc4d9108-ab31-4b7a-83be-0e9c7f1ab29a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:56.247616 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fc4d9108-ab31-4b7a-83be-0e9c7f1ab29a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:56.255895 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a4226546-9723-488a-8022-50bea9390556 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:56.257915 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fc4d9108-ab31-4b7a-83be-0e9c7f1ab29a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:56.258580 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fc4d9108-ab31-4b7a-83be-0e9c7f1ab29a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:56.259353 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fc4d9108-ab31-4b7a-83be-0e9c7f1ab29a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:56.259888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a4226546-9723-488a-8022-50bea9390556 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:56.260386 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fc4d9108-ab31-4b7a-83be-0e9c7f1ab29a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:56.265839 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a4226546-9723-488a-8022-50bea9390556 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:56.266522 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a4226546-9723-488a-8022-50bea9390556 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:56.591118 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a4226546-9723-488a-8022-50bea9390556 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:56.607139 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a4226546-9723-488a-8022-50bea9390556 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:56.608482 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fc4d9108-ab31-4b7a-83be-0e9c7f1ab29a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:56.609134 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a4226546-9723-488a-8022-50bea9390556 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:56.609913 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a4226546-9723-488a-8022-50bea9390556 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.378093 Jul 25 08:54:56.610808 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 450/937] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:56 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:56.617455 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fc4d9108-ab31-4b7a-83be-0e9c7f1ab29a tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.374642 Jul 25 08:54:56.628879 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 488/938] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:56 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:56.750202 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b17e84b3-fa87-4540-a856-edfacceb2d0c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:56.750876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b17e84b3-fa87-4540-a856-edfacceb2d0c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:56.758203 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b17e84b3-fa87-4540-a856-edfacceb2d0c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:56.758661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b17e84b3-fa87-4540-a856-edfacceb2d0c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:56.759447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b17e84b3-fa87-4540-a856-edfacceb2d0c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:56.759887 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b17e84b3-fa87-4540-a856-edfacceb2d0c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:56.937787 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b17e84b3-fa87-4540-a856-edfacceb2d0c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:56.947699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b17e84b3-fa87-4540-a856-edfacceb2d0c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1691 microversion: 2.1 time: 0.201805 Jul 25 08:54:56.948387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 451/939] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:56 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1691 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:57.635258 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-61894fca-8014-41d2-b676-9f24351fdb11 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:57.635983 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-61894fca-8014-41d2-b676-9f24351fdb11 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:57.638419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-90dc0e57-719f-4e96-b72c-12a49a834475 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:57.639052 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-90dc0e57-719f-4e96-b72c-12a49a834475 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:57.643262 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61894fca-8014-41d2-b676-9f24351fdb11 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:57.643811 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61894fca-8014-41d2-b676-9f24351fdb11 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:57.644959 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61894fca-8014-41d2-b676-9f24351fdb11 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:57.645529 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61894fca-8014-41d2-b676-9f24351fdb11 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:57.647166 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-90dc0e57-719f-4e96-b72c-12a49a834475 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:57.647589 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-90dc0e57-719f-4e96-b72c-12a49a834475 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:57.648610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-90dc0e57-719f-4e96-b72c-12a49a834475 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:57.648986 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-90dc0e57-719f-4e96-b72c-12a49a834475 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:57.868681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-90dc0e57-719f-4e96-b72c-12a49a834475 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:57.894293 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-90dc0e57-719f-4e96-b72c-12a49a834475 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.259990 Jul 25 08:54:57.894899 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 452/940] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:57 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:54:57.926260 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-61894fca-8014-41d2-b676-9f24351fdb11 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:57.934544 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-61894fca-8014-41d2-b676-9f24351fdb11 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:57.936092 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-61894fca-8014-41d2-b676-9f24351fdb11 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:57.937595 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-61894fca-8014-41d2-b676-9f24351fdb11 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.306771 Jul 25 08:54:57.938411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 489/941] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:57 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:54:57.970724 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-033cf0a1-dff2-4a51-a1c2-d39f881eaefa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:57.971371 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-033cf0a1-dff2-4a51-a1c2-d39f881eaefa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:57.977594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-033cf0a1-dff2-4a51-a1c2-d39f881eaefa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:57.978049 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-033cf0a1-dff2-4a51-a1c2-d39f881eaefa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:57.978828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-033cf0a1-dff2-4a51-a1c2-d39f881eaefa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:57.979266 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-033cf0a1-dff2-4a51-a1c2-d39f881eaefa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:58.114137 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-033cf0a1-dff2-4a51-a1c2-d39f881eaefa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:58.122029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-033cf0a1-dff2-4a51-a1c2-d39f881eaefa tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1691 microversion: 2.1 time: 0.156307 Jul 25 08:54:58.122610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 453/942] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:57 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:58.523209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-7cb77906-5602-4285-aa6d-56b6597f62e8 req-7bf3df27-ba95-4e79-82b1-13589e9b8f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48872a7-8219-4458-8832-bc33f66c0250", "name": "network-vif-plugged", "status": "completed", "tag": "8d036e4d-eb5b-4629-9fa0-863090220d9c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:54:58.533871 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7cb77906-5602-4285-aa6d-56b6597f62e8 req-7bf3df27-ba95-4e79-82b1-13589e9b8f7f service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:58.534330 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7cb77906-5602-4285-aa6d-56b6597f62e8 req-7bf3df27-ba95-4e79-82b1-13589e9b8f7f service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:58.546254 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-7cb77906-5602-4285-aa6d-56b6597f62e8 req-7bf3df27-ba95-4e79-82b1-13589e9b8f7f service nova] Creating event network-vif-plugged:8d036e4d-eb5b-4629-9fa0-863090220d9c for instance e48872a7-8219-4458-8832-bc33f66c0250 on hv-cinder-85084 Jul 25 08:54:58.551890 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-7cb77906-5602-4285-aa6d-56b6597f62e8 req-7bf3df27-ba95-4e79-82b1-13589e9b8f7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032068 Jul 25 08:54:58.553013 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 490/943] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:54:58.916087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-adbe5b0f-e0f4-4f08-adcc-71b1e3d17b54 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:58.916870 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-adbe5b0f-e0f4-4f08-adcc-71b1e3d17b54 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:58.923824 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-adbe5b0f-e0f4-4f08-adcc-71b1e3d17b54 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:58.924280 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-adbe5b0f-e0f4-4f08-adcc-71b1e3d17b54 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:58.925085 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-adbe5b0f-e0f4-4f08-adcc-71b1e3d17b54 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:58.925525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-adbe5b0f-e0f4-4f08-adcc-71b1e3d17b54 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:58.961983 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8f53b015-8d44-47ee-8b3c-34c736ad9ae5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:58.962678 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8f53b015-8d44-47ee-8b3c-34c736ad9ae5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:58.969058 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f53b015-8d44-47ee-8b3c-34c736ad9ae5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:58.969511 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f53b015-8d44-47ee-8b3c-34c736ad9ae5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:58.970288 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f53b015-8d44-47ee-8b3c-34c736ad9ae5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:58.970720 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f53b015-8d44-47ee-8b3c-34c736ad9ae5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:59.118565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-adbe5b0f-e0f4-4f08-adcc-71b1e3d17b54 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:59.126372 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-adbe5b0f-e0f4-4f08-adcc-71b1e3d17b54 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.214227 Jul 25 08:54:59.126939 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 454/944] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:58 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:54:59.143200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-60280ee3-dcc9-45db-8b6d-a0f6e384876c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:54:59.143883 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-60280ee3-dcc9-45db-8b6d-a0f6e384876c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:54:59.147310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8f53b015-8d44-47ee-8b3c-34c736ad9ae5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:59.150174 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60280ee3-dcc9-45db-8b6d-a0f6e384876c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:59.150692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60280ee3-dcc9-45db-8b6d-a0f6e384876c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:59.151555 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60280ee3-dcc9-45db-8b6d-a0f6e384876c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:54:59.152012 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60280ee3-dcc9-45db-8b6d-a0f6e384876c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:54:59.156064 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8f53b015-8d44-47ee-8b3c-34c736ad9ae5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:59.158401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8f53b015-8d44-47ee-8b3c-34c736ad9ae5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:59.159555 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8f53b015-8d44-47ee-8b3c-34c736ad9ae5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.202274 Jul 25 08:54:59.160133 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 491/945] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:54:58 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:54:59.287385 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-60280ee3-dcc9-45db-8b6d-a0f6e384876c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:54:59.295479 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-60280ee3-dcc9-45db-8b6d-a0f6e384876c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1691 microversion: 2.1 time: 0.156277 Jul 25 08:54:59.296059 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 455/946] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:54:59 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:55:00.151847 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7d6ae0d2-a300-4587-8438-52fd0dbea741 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:00.153730 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7d6ae0d2-a300-4587-8438-52fd0dbea741 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:00.175498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d6ae0d2-a300-4587-8438-52fd0dbea741 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:00.176003 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d6ae0d2-a300-4587-8438-52fd0dbea741 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:00.176976 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d6ae0d2-a300-4587-8438-52fd0dbea741 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:00.177616 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d6ae0d2-a300-4587-8438-52fd0dbea741 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:00.187063 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-20dfbaf9-48ca-452e-985f-4f5ac9e48936 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:00.188356 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-20dfbaf9-48ca-452e-985f-4f5ac9e48936 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:00.199605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20dfbaf9-48ca-452e-985f-4f5ac9e48936 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:00.200330 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20dfbaf9-48ca-452e-985f-4f5ac9e48936 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:00.201638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20dfbaf9-48ca-452e-985f-4f5ac9e48936 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:00.202344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-20dfbaf9-48ca-452e-985f-4f5ac9e48936 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:00.433620 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7d6ae0d2-a300-4587-8438-52fd0dbea741 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:00.447465 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-20dfbaf9-48ca-452e-985f-4f5ac9e48936 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:00.448253 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7d6ae0d2-a300-4587-8438-52fd0dbea741 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.303215 Jul 25 08:55:00.449096 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 492/947] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:00 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:00.454848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-56b284cf-4c06-4c03-b2aa-73ef03a28e2d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:00.455614 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-56b284cf-4c06-4c03-b2aa-73ef03a28e2d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:00.459876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-20dfbaf9-48ca-452e-985f-4f5ac9e48936 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:00.463483 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56b284cf-4c06-4c03-b2aa-73ef03a28e2d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:00.464169 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56b284cf-4c06-4c03-b2aa-73ef03a28e2d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:00.465451 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56b284cf-4c06-4c03-b2aa-73ef03a28e2d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:00.466623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56b284cf-4c06-4c03-b2aa-73ef03a28e2d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:00.467853 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-20dfbaf9-48ca-452e-985f-4f5ac9e48936 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:00.469938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-20dfbaf9-48ca-452e-985f-4f5ac9e48936 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1407 microversion: 2.20 time: 0.289217 Jul 25 08:55:00.470518 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 456/948] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:55:00 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:55:00.556327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-56b284cf-4c06-4c03-b2aa-73ef03a28e2d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:00.565401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-56b284cf-4c06-4c03-b2aa-73ef03a28e2d tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1624 microversion: 2.1 time: 0.114916 Jul 25 08:55:00.566000 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 493/949] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:00 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1624 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:00.670621 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-cbbabbc9-f8df-4bd5-948d-e6dff8693f1b req-ea710bb8-1755-4b00-92b4-1e3c7216675c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d", "name": "network-vif-deleted", "tag": "39973804-976f-4223-a900-f8cbbe4dcd0e"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:00.688782 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-cbbabbc9-f8df-4bd5-948d-e6dff8693f1b req-ea710bb8-1755-4b00-92b4-1e3c7216675c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:00.689989 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-cbbabbc9-f8df-4bd5-948d-e6dff8693f1b req-ea710bb8-1755-4b00-92b4-1e3c7216675c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:00.713554 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-cbbabbc9-f8df-4bd5-948d-e6dff8693f1b req-ea710bb8-1755-4b00-92b4-1e3c7216675c service nova] Creating event network-vif-deleted:39973804-976f-4223-a900-f8cbbe4dcd0e for instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d on hv-cinder-85084 Jul 25 08:55:00.722992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-cbbabbc9-f8df-4bd5-948d-e6dff8693f1b req-ea710bb8-1755-4b00-92b4-1e3c7216675c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058771 Jul 25 08:55:00.724371 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 457/950] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:01.481082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8e7c40fb-00e9-4932-8f44-e572b8ab5066 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:01.481836 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8e7c40fb-00e9-4932-8f44-e572b8ab5066 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:01.490921 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8e7c40fb-00e9-4932-8f44-e572b8ab5066 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:01.491733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8e7c40fb-00e9-4932-8f44-e572b8ab5066 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:01.493016 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8e7c40fb-00e9-4932-8f44-e572b8ab5066 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:01.493477 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8e7c40fb-00e9-4932-8f44-e572b8ab5066 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:01.506133 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3557cfc0-0b38-4d89-be17-e870615dcaa8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:01.507000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3557cfc0-0b38-4d89-be17-e870615dcaa8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:01.514711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3557cfc0-0b38-4d89-be17-e870615dcaa8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:01.515165 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3557cfc0-0b38-4d89-be17-e870615dcaa8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:01.516195 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3557cfc0-0b38-4d89-be17-e870615dcaa8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:01.516672 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3557cfc0-0b38-4d89-be17-e870615dcaa8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:01.737848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8e7c40fb-00e9-4932-8f44-e572b8ab5066 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:01.748491 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8e7c40fb-00e9-4932-8f44-e572b8ab5066 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1363 microversion: 2.1 time: 0.273365 Jul 25 08:55:01.749816 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3557cfc0-0b38-4d89-be17-e870615dcaa8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:01.760329 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3557cfc0-0b38-4d89-be17-e870615dcaa8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:01.762889 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 494/951] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:01 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:01.763382 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3557cfc0-0b38-4d89-be17-e870615dcaa8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:01.765232 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3557cfc0-0b38-4d89-be17-e870615dcaa8 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1600 microversion: 2.20 time: 0.263791 Jul 25 08:55:01.768763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:01.769714 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:01.772952 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 458/952] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:55:01 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1600 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:55:01.777223 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:01.777738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:01.778773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:01.779435 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:01.793238 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d1cde492-82c1-473a-8e4a-95ee3068bb66 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:01.794692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d1cde492-82c1-473a-8e4a-95ee3068bb66 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:01.803156 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1cde492-82c1-473a-8e4a-95ee3068bb66 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:01.803859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1cde492-82c1-473a-8e4a-95ee3068bb66 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:01.804962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1cde492-82c1-473a-8e4a-95ee3068bb66 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:01.805572 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d1cde492-82c1-473a-8e4a-95ee3068bb66 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:01.816125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:01.816714 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:01.817235 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lazy-loading 'fault' on Instance uuid f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:55:01.874414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:01.882497 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fbacf0b3-0e1b-46ac-b5da-dea0c37f073a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 200 len: 1336 microversion: 2.1 time: 0.118422 Jul 25 08:55:01.883080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 495/953] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:01 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:01.911760 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d1cde492-82c1-473a-8e4a-95ee3068bb66 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.122971 Jul 25 08:55:01.912367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 459/954] 10.222.0.52 () {60 vars in 1316 bytes} [Mon Jul 25 08:55:01 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 08:55:02.770817 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1c682160-743c-474c-9487-19b425e1870f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:02.771814 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1c682160-743c-474c-9487-19b425e1870f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:02.778906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c682160-743c-474c-9487-19b425e1870f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:02.779430 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c682160-743c-474c-9487-19b425e1870f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:02.780296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c682160-743c-474c-9487-19b425e1870f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:02.782093 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c682160-743c-474c-9487-19b425e1870f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:02.905414 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d6873dec-5264-4709-80ec-db1e366f7464 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:02.906052 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d6873dec-5264-4709-80ec-db1e366f7464 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:02.913408 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6873dec-5264-4709-80ec-db1e366f7464 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:02.913880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6873dec-5264-4709-80ec-db1e366f7464 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:02.914688 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6873dec-5264-4709-80ec-db1e366f7464 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:02.915461 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6873dec-5264-4709-80ec-db1e366f7464 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:02.934776 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-d6873dec-5264-4709-80ec-db1e366f7464 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] HTTP exception thrown: Instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d could not be found. Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d6873dec-5264-4709-80ec-db1e366f7464 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Request method failure captured: Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d HTTP/1.1 Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhAbHY67eQxIEbP7uZC63trv3RWNmE-jA4q-qfVkwamHlJqpEvc9tsVw9uR3CcU_zn9g9_Dy0hO19YlfNuDeBVc1FSa_xWLpptwFIXoXVOM5EcH3hxmFKKY6Sz8lkr-u8AfiW9Ly8IisZN4Iel1ZrDcboWjDo93zC7CUxuq-gvQGSs Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 7e61cbb537384f549eee9ec4c92d9d77 Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:55:02.936505 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e61cbb537384f549eee9ec4c92d9d77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7e61cbb537384f549eee9ec4c92d9d77", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7e61cbb537384f549eee9ec4c92d9d77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e61cbb537384f549eee9ec4c92d9d77"}]}] Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 7e61cbb537384f549eee9ec4c92d9d77 Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-ServerRescueNegativeTestJSON-1864573966-project Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 238f78244df546e5a6fc1a4cd1b73288 Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1864573966-project Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d could not be found. Jul 25 08:55:02.938125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d'} Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d could not be found. Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:02.938891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d could not be found. Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d could not be found. Jul 25 08:55:02.940472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:02.942631 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d6873dec-5264-4709-80ec-db1e366f7464 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Returning 404 to user: Instance f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:02.942631 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d6873dec-5264-4709-80ec-db1e366f7464 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d" status: 404 len: 111 microversion: 2.1 time: 0.037835 Jul 25 08:55:02.944099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 460/955] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:02 2022] GET /compute/v2.1/servers/f8a99ae3-2513-4cd3-bc23-d8a9e6eca69d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 08:55:02.949631 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c66197ac-2984-4d38-9c6a-9d26b081800a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '.version_select at 0x7f0f79966ca0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:02.975458 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c66197ac-2984-4d38-9c6a-9d26b081800a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824151767" status: 202 len: 0 microversion: 2.1 time: 0.030494 Jul 25 08:55:02.976172 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 461/956] 10.222.0.52 () {58 vars in 1221 bytes} [Mon Jul 25 08:55:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824151767 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:55:02.983768 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-07fd4c73-422d-423c-8187-039a377b8523 req-b3ec9019-db2f-4518-9e96-b310d0ae7db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f22e6c-5c89-42ee-90ce-a87e77bfa17b", "tag": "68b8d737-1cd3-4135-ad4b-35b7ce49fc3d"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:02.996609 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-07fd4c73-422d-423c-8187-039a377b8523 req-b3ec9019-db2f-4518-9e96-b310d0ae7db6 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:02.996965 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-07fd4c73-422d-423c-8187-039a377b8523 req-b3ec9019-db2f-4518-9e96-b310d0ae7db6 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:03.009768 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1c682160-743c-474c-9487-19b425e1870f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:03.010690 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-07fd4c73-422d-423c-8187-039a377b8523 req-b3ec9019-db2f-4518-9e96-b310d0ae7db6 service nova] Creating event network-changed:68b8d737-1cd3-4135-ad4b-35b7ce49fc3d for instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b on hv-cinder-85084 Jul 25 08:55:03.018062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-07fd4c73-422d-423c-8187-039a377b8523 req-b3ec9019-db2f-4518-9e96-b310d0ae7db6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039970 Jul 25 08:55:03.019542 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 462/957] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:03.022764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1c682160-743c-474c-9487-19b425e1870f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1550 microversion: 2.1 time: 0.256608 Jul 25 08:55:03.023946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 496/958] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:02 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1550 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:03.046683 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e4afbc48-829f-43e1-bab0-3411d10a8488 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:03.049005 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e4afbc48-829f-43e1-bab0-3411d10a8488 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:03.057630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e4afbc48-829f-43e1-bab0-3411d10a8488 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:03.058563 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e4afbc48-829f-43e1-bab0-3411d10a8488 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:03.060075 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e4afbc48-829f-43e1-bab0-3411d10a8488 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:03.060801 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e4afbc48-829f-43e1-bab0-3411d10a8488 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:03.180893 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e4afbc48-829f-43e1-bab0-3411d10a8488 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138073 Jul 25 08:55:03.182679 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 463/959] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Jul 25 08:55:03 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:04.971645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-f478a981-6c46-4e8b-9f04-b85b243fceef req-f737dc5e-21dd-4f2f-baea-777a751517d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48872a7-8219-4458-8832-bc33f66c0250", "tag": "8d036e4d-eb5b-4629-9fa0-863090220d9c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:04.982497 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-f478a981-6c46-4e8b-9f04-b85b243fceef req-f737dc5e-21dd-4f2f-baea-777a751517d4 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:04.982938 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-f478a981-6c46-4e8b-9f04-b85b243fceef req-f737dc5e-21dd-4f2f-baea-777a751517d4 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:04.994347 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-f478a981-6c46-4e8b-9f04-b85b243fceef req-f737dc5e-21dd-4f2f-baea-777a751517d4 service nova] Creating event network-changed:8d036e4d-eb5b-4629-9fa0-863090220d9c for instance e48872a7-8219-4458-8832-bc33f66c0250 on hv-cinder-85084 Jul 25 08:55:04.999663 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-f478a981-6c46-4e8b-9f04-b85b243fceef req-f737dc5e-21dd-4f2f-baea-777a751517d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032815 Jul 25 08:55:05.000601 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 497/960] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:06.447187 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f573de1c-b7f5-4035-86f9-41b87ed486a3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:06.447738 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f573de1c-b7f5-4035-86f9-41b87ed486a3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:06.454458 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f573de1c-b7f5-4035-86f9-41b87ed486a3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:06.454907 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f573de1c-b7f5-4035-86f9-41b87ed486a3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:06.455677 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f573de1c-b7f5-4035-86f9-41b87ed486a3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:06.456115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f573de1c-b7f5-4035-86f9-41b87ed486a3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:06.481746 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f573de1c-b7f5-4035-86f9-41b87ed486a3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:55:06.562522 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f573de1c-b7f5-4035-86f9-41b87ed486a3 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "DELETE /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 204 len: 0 microversion: 2.1 time: 0.119414 Jul 25 08:55:06.563802 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 464/961] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:55:06 2022] DELETE /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:55:06.572449 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-79ffb277-d640-44f4-829f-88e66c654b7a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:06.573166 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-79ffb277-d640-44f4-829f-88e66c654b7a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:06.580708 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79ffb277-d640-44f4-829f-88e66c654b7a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:06.581161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79ffb277-d640-44f4-829f-88e66c654b7a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:06.581933 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79ffb277-d640-44f4-829f-88e66c654b7a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:06.582368 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79ffb277-d640-44f4-829f-88e66c654b7a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:06.723491 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-79ffb277-d640-44f4-829f-88e66c654b7a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:06.731967 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-79ffb277-d640-44f4-829f-88e66c654b7a tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1508 microversion: 2.1 time: 0.163577 Jul 25 08:55:06.732718 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 498/962] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:06 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:07.753391 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ed65cf1c-91e2-46ab-93dd-2e405c710946 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:07.754120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ed65cf1c-91e2-46ab-93dd-2e405c710946 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:07.761043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ed65cf1c-91e2-46ab-93dd-2e405c710946 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:07.761503 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ed65cf1c-91e2-46ab-93dd-2e405c710946 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:07.762277 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ed65cf1c-91e2-46ab-93dd-2e405c710946 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:07.762721 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ed65cf1c-91e2-46ab-93dd-2e405c710946 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:07.899863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ed65cf1c-91e2-46ab-93dd-2e405c710946 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:07.908253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ed65cf1c-91e2-46ab-93dd-2e405c710946 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 200 len: 1508 microversion: 2.1 time: 0.159025 Jul 25 08:55:07.909190 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 465/963] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:07 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:08.054226 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-b2e8e2cb-f4e6-440e-9550-f3cdfd1c65ec req-2a8c6bf5-a495-4796-97fa-e728501b203c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a72735-dc04-46c8-93bb-0ac441aed151", "name": "network-vif-deleted", "tag": "28a4c653-6358-4c44-a455-40a51fe64fbc"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:08.065572 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-b2e8e2cb-f4e6-440e-9550-f3cdfd1c65ec req-2a8c6bf5-a495-4796-97fa-e728501b203c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:08.066022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-b2e8e2cb-f4e6-440e-9550-f3cdfd1c65ec req-2a8c6bf5-a495-4796-97fa-e728501b203c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:08.230293 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-b2e8e2cb-f4e6-440e-9550-f3cdfd1c65ec req-2a8c6bf5-a495-4796-97fa-e728501b203c service nova] Creating event network-vif-deleted:28a4c653-6358-4c44-a455-40a51fe64fbc for instance 71a72735-dc04-46c8-93bb-0ac441aed151 on hv-cinder-85084 Jul 25 08:55:08.235814 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-b2e8e2cb-f4e6-440e-9550-f3cdfd1c65ec req-2a8c6bf5-a495-4796-97fa-e728501b203c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185232 Jul 25 08:55:08.236407 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 499/964] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:08.931644 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-22b46a23-5504-4030-9b5b-006588099d80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:08.932737 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-22b46a23-5504-4030-9b5b-006588099d80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 71a72735-dc04-46c8-93bb-0ac441aed151] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:08.941948 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-22b46a23-5504-4030-9b5b-006588099d80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:08.942542 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-22b46a23-5504-4030-9b5b-006588099d80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:08.943601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-22b46a23-5504-4030-9b5b-006588099d80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:08.944205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-22b46a23-5504-4030-9b5b-006588099d80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:08.964012 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-22b46a23-5504-4030-9b5b-006588099d80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] HTTP exception thrown: Instance 71a72735-dc04-46c8-93bb-0ac441aed151 could not be found. Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-22b46a23-5504-4030-9b5b-006588099d80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Request method failure captured: Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 HTTP/1.1 Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhAbHY67eQxIEbP7uZC63trv3RWNmE-jA4q-qfVkwamHlJqpEvc9tsVw9uR3CcU_zn9g9_Dy0hO19YlfNuDeBVc1FSa_xWLpptwFIXoXVOM5EcH3hxmFKKY6Sz8lkr-u8AfiW9Ly8IisZN4Iel1ZrDcboWjDo93zC7CUxuq-gvQGSs Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 7e61cbb537384f549eee9ec4c92d9d77 Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:55:08.966452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e61cbb537384f549eee9ec4c92d9d77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7e61cbb537384f549eee9ec4c92d9d77", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7e61cbb537384f549eee9ec4c92d9d77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e61cbb537384f549eee9ec4c92d9d77"}]}] Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 7e61cbb537384f549eee9ec4c92d9d77 Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-ServerRescueNegativeTestJSON-1864573966-project Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 238f78244df546e5a6fc1a4cd1b73288 Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1864573966-project Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 71a72735-dc04-46c8-93bb-0ac441aed151 could not be found. Jul 25 08:55:08.968017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '71a72735-dc04-46c8-93bb-0ac441aed151'} Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a72735-dc04-46c8-93bb-0ac441aed151 could not be found. Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:08.969333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a72735-dc04-46c8-93bb-0ac441aed151 could not be found. Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a72735-dc04-46c8-93bb-0ac441aed151 could not be found. Jul 25 08:55:08.970732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:08.972078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-22b46a23-5504-4030-9b5b-006588099d80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Returning 404 to user: Instance 71a72735-dc04-46c8-93bb-0ac441aed151 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:08.972078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-22b46a23-5504-4030-9b5b-006588099d80 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151" status: 404 len: 111 microversion: 2.1 time: 0.042483 Jul 25 08:55:08.972078 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 466/965] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:08 2022] GET /compute/v2.1/servers/71a72735-dc04-46c8-93bb-0ac441aed151 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:55:08.979151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7d036c1e-81c7-42ec-a168-30f0d7410cb8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:08.979755 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7d036c1e-81c7-42ec-a168-30f0d7410cb8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:08.987827 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d036c1e-81c7-42ec-a168-30f0d7410cb8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:08.988438 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d036c1e-81c7-42ec-a168-30f0d7410cb8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:08.989336 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d036c1e-81c7-42ec-a168-30f0d7410cb8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:08.989824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d036c1e-81c7-42ec-a168-30f0d7410cb8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:09.025351 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7d036c1e-81c7-42ec-a168-30f0d7410cb8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:55:09.135200 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7d036c1e-81c7-42ec-a168-30f0d7410cb8 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "DELETE /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 204 len: 0 microversion: 2.1 time: 0.160260 Jul 25 08:55:09.136276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 500/966] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:55:08 2022] DELETE /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:55:09.146250 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f1a9954e-e755-4069-b0bc-700168f17c2c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:09.147422 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f1a9954e-e755-4069-b0bc-700168f17c2c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:09.153684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1a9954e-e755-4069-b0bc-700168f17c2c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:09.154147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1a9954e-e755-4069-b0bc-700168f17c2c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:09.154967 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1a9954e-e755-4069-b0bc-700168f17c2c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:09.155409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f1a9954e-e755-4069-b0bc-700168f17c2c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:09.289860 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f1a9954e-e755-4069-b0bc-700168f17c2c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:09.298144 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f1a9954e-e755-4069-b0bc-700168f17c2c tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.157048 Jul 25 08:55:09.298360 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 467/967] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:09 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:10.321281 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f070553e-9c95-42cd-8514-8640bdac92fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:10.322345 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f070553e-9c95-42cd-8514-8640bdac92fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:10.329365 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f070553e-9c95-42cd-8514-8640bdac92fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:10.329823 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f070553e-9c95-42cd-8514-8640bdac92fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:10.330605 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f070553e-9c95-42cd-8514-8640bdac92fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:10.331053 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f070553e-9c95-42cd-8514-8640bdac92fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:10.495991 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f070553e-9c95-42cd-8514-8640bdac92fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238f78244df546e5a6fc1a4cd1b73288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e61cbb537384f549eee9ec4c92d9d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:10.505217 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f070553e-9c95-42cd-8514-8640bdac92fd tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 200 len: 1522 microversion: 2.1 time: 0.188724 Jul 25 08:55:10.506426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 501/968] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:10 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:10.525053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-67deaaf0-63bc-4840-9ae6-c41e3c43ddba req-a238e36a-6616-43d7-ab33-3ebdeb0680d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b16067-f13e-472e-a335-bbb66b7461b1", "name": "network-vif-deleted", "tag": "4e4d0870-3b4e-4551-b50c-c4f668b497de"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:10.536193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-67deaaf0-63bc-4840-9ae6-c41e3c43ddba req-a238e36a-6616-43d7-ab33-3ebdeb0680d6 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:10.536655 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-67deaaf0-63bc-4840-9ae6-c41e3c43ddba req-a238e36a-6616-43d7-ab33-3ebdeb0680d6 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:10.540747 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:10.550087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-67deaaf0-63bc-4840-9ae6-c41e3c43ddba req-a238e36a-6616-43d7-ab33-3ebdeb0680d6 service nova] Creating event network-vif-deleted:4e4d0870-3b4e-4551-b50c-c4f668b497de for instance 22b16067-f13e-472e-a335-bbb66b7461b1 on hv-cinder-85084 Jul 25 08:55:10.554791 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-67deaaf0-63bc-4840-9ae6-c41e3c43ddba req-a238e36a-6616-43d7-ab33-3ebdeb0680d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033137 Jul 25 08:55:10.555344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 468/969] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:11.525770 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ec65c167-e9b5-47b8-83b3-faaa970b90f5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:11.526365 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ec65c167-e9b5-47b8-83b3-faaa970b90f5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] [instance: 22b16067-f13e-472e-a335-bbb66b7461b1] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:11.535709 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec65c167-e9b5-47b8-83b3-faaa970b90f5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:11.536325 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec65c167-e9b5-47b8-83b3-faaa970b90f5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:11.537247 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec65c167-e9b5-47b8-83b3-faaa970b90f5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:11.537685 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec65c167-e9b5-47b8-83b3-faaa970b90f5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:11.556924 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-ec65c167-e9b5-47b8-83b3-faaa970b90f5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] HTTP exception thrown: Instance 22b16067-f13e-472e-a335-bbb66b7461b1 could not be found. Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ec65c167-e9b5-47b8-83b3-faaa970b90f5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Request method failure captured: Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 HTTP/1.1 Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhAbHY67eQxIEbP7uZC63trv3RWNmE-jA4q-qfVkwamHlJqpEvc9tsVw9uR3CcU_zn9g9_Dy0hO19YlfNuDeBVc1FSa_xWLpptwFIXoXVOM5EcH3hxmFKKY6Sz8lkr-u8AfiW9Ly8IisZN4Iel1ZrDcboWjDo93zC7CUxuq-gvQGSs Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 7e61cbb537384f549eee9ec4c92d9d77 Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:55:11.558573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e61cbb537384f549eee9ec4c92d9d77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7e61cbb537384f549eee9ec4c92d9d77", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7e61cbb537384f549eee9ec4c92d9d77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e61cbb537384f549eee9ec4c92d9d77"}]}] Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 7e61cbb537384f549eee9ec4c92d9d77 Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1864573966 Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-ServerRescueNegativeTestJSON-1864573966-project Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 238f78244df546e5a6fc1a4cd1b73288 Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1864573966-project Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 22b16067-f13e-472e-a335-bbb66b7461b1 could not be found. Jul 25 08:55:11.560155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '22b16067-f13e-472e-a335-bbb66b7461b1'} Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b16067-f13e-472e-a335-bbb66b7461b1 could not be found. Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:11.561115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b16067-f13e-472e-a335-bbb66b7461b1 could not be found. Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b16067-f13e-472e-a335-bbb66b7461b1 could not be found. Jul 25 08:55:11.562590 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:11.564506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ec65c167-e9b5-47b8-83b3-faaa970b90f5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] Returning 404 to user: Instance 22b16067-f13e-472e-a335-bbb66b7461b1 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:11.564506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ec65c167-e9b5-47b8-83b3-faaa970b90f5 tempest-ServerRescueNegativeTestJSON-1864573966 tempest-ServerRescueNegativeTestJSON-1864573966-project] 10.222.0.52 "GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1" status: 404 len: 111 microversion: 2.1 time: 0.038040 Jul 25 08:55:11.564506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 502/970] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:11 2022] GET /compute/v2.1/servers/22b16067-f13e-472e-a335-bbb66b7461b1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:55:16.670271 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c7f80e6b-faa9-4634-8847-120e71270c9c tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Action: 'create', calling method: .version_select at 0x7f0f79b789d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-33477056"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:16.974034 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c7f80e6b-faa9-4634-8847-120e71270c9c tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.430670 Jul 25 08:55:16.974660 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 469/971] 10.222.0.52 () {60 vars in 1155 bytes} [Mon Jul 25 08:55:16 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 432 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 08:55:16.987460 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8baa9d01-b126-4359-9c3e-793b2b26dfdf tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f7995f700>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:17.049576 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8baa9d01-b126-4359-9c3e-793b2b26dfdf tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14" status: 200 len: 343 microversion: 2.1 time: 0.066069 Jul 25 08:55:17.050557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 503/972] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:55:16 2022] GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14 => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:55:18.065138 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c398c7a1-5d17-4702-9f4e-1cb200b5a2c5 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79b4a280>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:18.111545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c398c7a1-5d17-4702-9f4e-1cb200b5a2c5 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14" status: 200 len: 344 microversion: 2.1 time: 0.051345 Jul 25 08:55:18.112120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 470/973] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:55:18 2022] GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:55:18.126055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1382079b-e14a-4825-b6a6-9aedfc469c66 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Action: 'create', calling method: .version_select at 0x7f0f79921160>, body: {"snapshot": {"volume_id": "de97dad3-ff10-495a-90df-979c391e5d14", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1366300526"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:18.277230 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1382079b-e14a-4825-b6a6-9aedfc469c66 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.155993 Jul 25 08:55:18.277810 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 504/974] 10.222.0.52 () {60 vars in 1162 bytes} [Mon Jul 25 08:55:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:18.288719 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fba582f4-15b0-4791-bd94-368c7c32e047 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79b4ac10>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:18.326504 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fba582f4-15b0-4791-bd94-368c7c32e047 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825" status: 200 len: 287 microversion: 2.1 time: 0.041718 Jul 25 08:55:18.327087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 471/975] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Jul 25 08:55:18 2022] GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:18.337872 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b6efd967-3514-4b0e-8aa3-5825a6d1dc71 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f7995f670>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:18.371296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b6efd967-3514-4b0e-8aa3-5825a6d1dc71 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037120 Jul 25 08:55:18.371872 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 505/976] 10.222.0.52 () {58 vars in 1140 bytes} [Mon Jul 25 08:55:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:18.383969 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0440380b-deb0-4d1a-9a01-56fa368ccc24 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79b4a1f0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:18.414006 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0440380b-deb0-4d1a-9a01-56fa368ccc24 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825" status: 200 len: 287 microversion: 2.1 time: 0.034090 Jul 25 08:55:18.414680 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 472/977] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Jul 25 08:55:18 2022] GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:19.427629 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9daad1b7-c3d3-4cde-a8e0-08d8d63b6b35 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f799f55e0>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:19.458742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9daad1b7-c3d3-4cde-a8e0-08d8d63b6b35 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825" status: 200 len: 287 microversion: 2.1 time: 0.035439 Jul 25 08:55:19.459310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 506/978] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Jul 25 08:55:19 2022] GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:20.471591 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-12c4a632-f7f5-4964-a402-3b6e5b8ad235 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79b174c0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:20.506080 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-12c4a632-f7f5-4964-a402-3b6e5b8ad235 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825" status: 200 len: 287 microversion: 2.1 time: 0.038510 Jul 25 08:55:20.507174 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 473/979] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Jul 25 08:55:20 2022] GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:21.520609 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8726c025-aea3-4d8a-a200-487e0c24c87b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f799ddf70>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:21.531006 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:21.546069 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:21.553328 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8726c025-aea3-4d8a-a200-487e0c24c87b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825" status: 200 len: 287 microversion: 2.1 time: 0.037930 Jul 25 08:55:21.554372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 507/980] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Jul 25 08:55:21 2022] GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:22.563523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:22.567939 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7d196097-630e-4495-a2b5-5b93e38f690e tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79b78940>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:22.601388 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7d196097-630e-4495-a2b5-5b93e38f690e tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825" status: 200 len: 287 microversion: 2.1 time: 0.038659 Jul 25 08:55:22.601967 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 474/981] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Jul 25 08:55:22 2022] GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:23.614396 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-045d1897-5d69-4acd-adf2-b010d8c901b9 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79921dc0>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:23.646100 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-045d1897-5d69-4acd-adf2-b010d8c901b9 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825" status: 200 len: 288 microversion: 2.1 time: 0.036618 Jul 25 08:55:23.646665 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 508/982] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Jul 25 08:55:23 2022] GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:23.658143 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6c667edd-e79b-4c1a-8c30-b2631baf9bf9 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f799663a0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:23.716235 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6c667edd-e79b-4c1a-8c30-b2631baf9bf9 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825" status: 202 len: 0 microversion: 2.1 time: 0.062326 Jul 25 08:55:23.716841 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 475/983] 10.222.0.52 () {58 vars in 1254 bytes} [Mon Jul 25 08:55:23 2022] DELETE /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:55:23.725126 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2d5ceef0-9056-4d17-a87d-288f4ba5cda8 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79892d30>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:23.755386 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2d5ceef0-9056-4d17-a87d-288f4ba5cda8 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825" status: 200 len: 287 microversion: 2.1 time: 0.034150 Jul 25 08:55:23.755951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 509/984] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Jul 25 08:55:23 2022] GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:55:24.768456 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2179f519-e190-4192-8b78-7dec5d93b8fe tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79b0c940>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:24.793192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-2179f519-e190-4192-8b78-7dec5d93b8fe tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] HTTP exception thrown: Snapshot 87ea2077-e9a4-42c9-bbf6-c2b3f4388825 could not be found. Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2179f519-e190-4192-8b78-7dec5d93b8fe tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Request method failure captured: Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 HTTP/1.1 Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lp0pBB53KHP8vptuEntqhD8zbRKOEcxKPTm8bozRGWI0ihUgxAIV6HMJe1xL6-_UcZMJoSgF4rPEq6ZpiUmlIsIPEuSJJKHxvb_8kPedHPZPL_bTOTIbprMJvYSQuUYSxjQK2CittPFVahBCbtD9zpUl8ZF4oYsXSNW1f-ao7kVA7Q Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 161188f13b02425987c1a1ac5c497751 Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:55:24.800903 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/161188f13b02425987c1a1ac5c497751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_161188f13b02425987c1a1ac5c497751", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/161188f13b02425987c1a1ac5c497751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/161188f13b02425987c1a1ac5c497751"}]}] Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 161188f13b02425987c1a1ac5c497751 Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-VolumesSnapshotsTestJSON-580020067-project Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 2f383ccb6ba740eca9543214d828d295 Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-VolumesSnapshotsTestJSON-580020067-project Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Snapshot 87ea2077-e9a4-42c9-bbf6-c2b3f4388825 could not be found. Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '87ea2077-e9a4-42c9-bbf6-c2b3f4388825'} Jul 25 08:55:24.802442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 87ea2077-e9a4-42c9-bbf6-c2b3f4388825 could not be found. (HTTP 404) (Request-ID: req-a40d7aa2-2d91-411a-97f2-0abbd801969e) Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:24.803361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 08:55:24.804610 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 87ea2077-e9a4-42c9-bbf6-c2b3f4388825 could not be found. Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 08:55:24.805984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 87ea2077-e9a4-42c9-bbf6-c2b3f4388825 could not be found. Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 87ea2077-e9a4-42c9-bbf6-c2b3f4388825 could not be found. Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2179f519-e190-4192-8b78-7dec5d93b8fe tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Returning 404 to user: Snapshot 87ea2077-e9a4-42c9-bbf6-c2b3f4388825 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2179f519-e190-4192-8b78-7dec5d93b8fe tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825" status: 404 len: 111 microversion: 2.1 time: 0.039015 Jul 25 08:55:24.807471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 476/985] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Jul 25 08:55:24 2022] GET /compute/v2.1/os-snapshots/87ea2077-e9a4-42c9-bbf6-c2b3f4388825 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:55:24.816927 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-943232cd-9cde-4ba6-ac92-270d7fdba641 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f7995f310>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:24.878890 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-943232cd-9cde-4ba6-ac92-270d7fdba641 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14" status: 202 len: 0 microversion: 2.1 time: 0.069331 Jul 25 08:55:24.879454 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 510/986] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Jul 25 08:55:24 2022] DELETE /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:55:24.888516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3292fb75-684b-4a06-b39a-f351a90854b4 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79b0cee0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:24.941931 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3292fb75-684b-4a06-b39a-f351a90854b4 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14" status: 200 len: 343 microversion: 2.1 time: 0.058118 Jul 25 08:55:24.942509 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 477/987] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:55:24 2022] GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14 => generated 343 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:25.957081 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-33197a07-ff8c-4d6e-84a5-09558147c76b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79921040>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:25.987465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-33197a07-ff8c-4d6e-84a5-09558147c76b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] HTTP exception thrown: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-33197a07-ff8c-4d6e-84a5-09558147c76b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Request method failure captured: Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14 HTTP/1.1 Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lp0pBB53KHP8vptuEntqhD8zbRKOEcxKPTm8bozRGWI0ihUgxAIV6HMJe1xL6-_UcZMJoSgF4rPEq6ZpiUmlIsIPEuSJJKHxvb_8kPedHPZPL_bTOTIbprMJvYSQuUYSxjQK2CittPFVahBCbtD9zpUl8ZF4oYsXSNW1f-ao7kVA7Q Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 161188f13b02425987c1a1ac5c497751 Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:55:25.991075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/161188f13b02425987c1a1ac5c497751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_161188f13b02425987c1a1ac5c497751", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/161188f13b02425987c1a1ac5c497751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/161188f13b02425987c1a1ac5c497751"}]}] Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 161188f13b02425987c1a1ac5c497751 Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesSnapshotsTestJSON-580020067-project Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 2f383ccb6ba740eca9543214d828d295 Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesSnapshotsTestJSON-580020067-project Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': 'de97dad3-ff10-495a-90df-979c391e5d14'} Jul 25 08:55:25.993557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. (HTTP 404) (Request-ID: req-31ea4369-2602-451c-b830-bc3ae9aab19d) Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:25.995277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 08:55:25.997466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 08:55:26.000674 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-33197a07-ff8c-4d6e-84a5-09558147c76b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Returning 404 to user: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-33197a07-ff8c-4d6e-84a5-09558147c76b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14" status: 404 len: 109 microversion: 2.1 time: 0.040331 Jul 25 08:55:26.002978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 511/988] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:55:25 2022] GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:55:26.006542 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-637dd477-cf36-4d42-8823-e8aafe2c544b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79b4a1f0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:26.035235 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-637dd477-cf36-4d42-8823-e8aafe2c544b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] HTTP exception thrown: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-637dd477-cf36-4d42-8823-e8aafe2c544b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Request method failure captured: Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: DELETE /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14 HTTP/1.1 Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lp0pBB53KHP8vptuEntqhD8zbRKOEcxKPTm8bozRGWI0ihUgxAIV6HMJe1xL6-_UcZMJoSgF4rPEq6ZpiUmlIsIPEuSJJKHxvb_8kPedHPZPL_bTOTIbprMJvYSQuUYSxjQK2CittPFVahBCbtD9zpUl8ZF4oYsXSNW1f-ao7kVA7Q Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 161188f13b02425987c1a1ac5c497751 Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:55:26.038043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/161188f13b02425987c1a1ac5c497751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_161188f13b02425987c1a1ac5c497751", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/161188f13b02425987c1a1ac5c497751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/161188f13b02425987c1a1ac5c497751"}]}] Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 161188f13b02425987c1a1ac5c497751 Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-VolumesSnapshotsTestJSON-580020067-project Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 2f383ccb6ba740eca9543214d828d295 Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-VolumesSnapshotsTestJSON-580020067-project Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'de97dad3-ff10-495a-90df-979c391e5d14'} Jul 25 08:55:26.039699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. (HTTP 404) (Request-ID: req-71796366-507e-4698-b1cc-8b2df1572062) Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:26.040750 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 08:55:26.042324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 08:55:26.043992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-637dd477-cf36-4d42-8823-e8aafe2c544b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Returning 404 to user: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-637dd477-cf36-4d42-8823-e8aafe2c544b tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14" status: 404 len: 109 microversion: 2.1 time: 0.038976 Jul 25 08:55:26.045681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 478/989] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Jul 25 08:55:25 2022] DELETE /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 08:55:26.051068 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f433b161-97c0-489e-b2df-ea300521a311 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Calling method '.version_select at 0x7f0f79a2c160>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:26.081296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-f433b161-97c0-489e-b2df-ea300521a311 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] HTTP exception thrown: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f433b161-97c0-489e-b2df-ea300521a311 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Request method failure captured: Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14 HTTP/1.1 Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lp0pBB53KHP8vptuEntqhD8zbRKOEcxKPTm8bozRGWI0ihUgxAIV6HMJe1xL6-_UcZMJoSgF4rPEq6ZpiUmlIsIPEuSJJKHxvb_8kPedHPZPL_bTOTIbprMJvYSQuUYSxjQK2CittPFVahBCbtD9zpUl8ZF4oYsXSNW1f-ao7kVA7Q Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 161188f13b02425987c1a1ac5c497751 Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:55:26.083363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/161188f13b02425987c1a1ac5c497751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_161188f13b02425987c1a1ac5c497751", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/161188f13b02425987c1a1ac5c497751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/161188f13b02425987c1a1ac5c497751"}]}] Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 161188f13b02425987c1a1ac5c497751 Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-580020067 Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesSnapshotsTestJSON-580020067-project Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 2f383ccb6ba740eca9543214d828d295 Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesSnapshotsTestJSON-580020067-project Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': 'de97dad3-ff10-495a-90df-979c391e5d14'} Jul 25 08:55:26.085094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. (HTTP 404) (Request-ID: req-c5c73a01-48f7-4e54-9f9b-be6deda30258) Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:26.086149 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 08:55:26.087848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 08:55:26.089249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f433b161-97c0-489e-b2df-ea300521a311 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] Returning 404 to user: Volume de97dad3-ff10-495a-90df-979c391e5d14 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f433b161-97c0-489e-b2df-ea300521a311 tempest-VolumesSnapshotsTestJSON-580020067 tempest-VolumesSnapshotsTestJSON-580020067-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14" status: 404 len: 109 microversion: 2.1 time: 0.038332 Jul 25 08:55:26.091366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 512/990] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:55:26 2022] GET /compute/v2.1/os-volumes/de97dad3-ff10-495a-90df-979c391e5d14 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 08:55:27.672674 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6ba7555d-fcae-4794-baeb-7ea689ea95ee tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Action: 'create', calling method: .version_select at 0x7f0f7989b700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1049169237", "metadata": {"Type": "work"}}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6ba7555d-fcae-4794-baeb-7ea689ea95ee tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Request method failure captured: Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 122 Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lp_ROyfoEZs80IlDsN573Qmp7rbYfs7a0ugkn-3N2AlVozYZvYt20GxReYbRTrL6KZARNTrHba2-jXEcdfYqQjwUELJKoPFl8TZrAydpzJiS-zq1hpzQsQula0lilkTEtghUgG-nJWU13GhdmDcMzzeZpfA6JjgJG3Pb09YXn2Qa5o Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:55:27.690218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd6083e6f18454781ae160d105c568e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}] Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 51cee82858d9446da50aab697dfcc3f3 Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1049169237", "metadata": {"Type": "work"}}} Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: Jul 25 08:55:27.691876 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1049169237', 'metadata': {'Type': 'work'}}}} Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise error Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:27.693099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 08:55:27.694755 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 08:55:27.696284 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 08:55:27.696284 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.696284 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-6ba7555d-fcae-4794-baeb-7ea689ea95ee tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:27.696284 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-6ba7555d-fcae-4794-baeb-7ea689ea95ee tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143593 Jul 25 08:55:27.696284 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 479/991] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Jul 25 08:55:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 08:55:27.702916 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3c67b65d-0333-4e0b-ac0a-0ac889f93a5c tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Action: 'create', calling method: .version_select at 0x7f0f79a2c4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-880495247", "metadata": {"Type": "work"}}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3c67b65d-0333-4e0b-ac0a-0ac889f93a5c tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Request method failure captured: Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 119 Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lp_ROyfoEZs80IlDsN573Qmp7rbYfs7a0ugkn-3N2AlVozYZvYt20GxReYbRTrL6KZARNTrHba2-jXEcdfYqQjwUELJKoPFl8TZrAydpzJiS-zq1hpzQsQula0lilkTEtghUgG-nJWU13GhdmDcMzzeZpfA6JjgJG3Pb09YXn2Qa5o Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:55:27.708031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd6083e6f18454781ae160d105c568e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}] Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 51cee82858d9446da50aab697dfcc3f3 Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-880495247", "metadata": {"Type": "work"}}} Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: Jul 25 08:55:27.710433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-880495247', 'metadata': {'Type': 'work'}}}} Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise error Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi '0' Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:27.711327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 08:55:27.712822 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 08:55:27.713992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 08:55:27.713992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.713992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3c67b65d-0333-4e0b-ac0a-0ac889f93a5c tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:27.713992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3c67b65d-0333-4e0b-ac0a-0ac889f93a5c tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011436 Jul 25 08:55:27.713992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 513/992] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Jul 25 08:55:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 08:55:27.719373 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b374d13a-d98f-464c-9d04-a605eded3915 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Action: 'create', calling method: .version_select at 0x7f0f79afcca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-878341114", "metadata": {"Type": "work"}}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b374d13a-d98f-464c-9d04-a605eded3915 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Request method failure captured: Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 118 Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lp_ROyfoEZs80IlDsN573Qmp7rbYfs7a0ugkn-3N2AlVozYZvYt20GxReYbRTrL6KZARNTrHba2-jXEcdfYqQjwUELJKoPFl8TZrAydpzJiS-zq1hpzQsQula0lilkTEtghUgG-nJWU13GhdmDcMzzeZpfA6JjgJG3Pb09YXn2Qa5o Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:55:27.722944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd6083e6f18454781ae160d105c568e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}] Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 51cee82858d9446da50aab697dfcc3f3 Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-878341114", "metadata": {"Type": "work"}}} Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: Jul 25 08:55:27.724633 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-878341114', 'metadata': {'Type': 'work'}}}} Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise error Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi '' Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:27.725711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 08:55:27.727320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 08:55:27.728878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 08:55:27.728878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.728878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b374d13a-d98f-464c-9d04-a605eded3915 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:27.728878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b374d13a-d98f-464c-9d04-a605eded3915 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008861 Jul 25 08:55:27.728878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 480/993] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Jul 25 08:55:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 08:55:27.737910 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0eff8c29-27ec-4aad-9c2b-86be54bef632 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Calling method '.version_select at 0x7f0f79a23e50>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:27.767723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-0eff8c29-27ec-4aad-9c2b-86be54bef632 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] HTTP exception thrown: Volume tempest-invalid-2016392931 could not be found. Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0eff8c29-27ec-4aad-9c2b-86be54bef632 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Request method failure captured: Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2016392931 HTTP/1.1 Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lp_ROyfoEZs80IlDsN573Qmp7rbYfs7a0ugkn-3N2AlVozYZvYt20GxReYbRTrL6KZARNTrHba2-jXEcdfYqQjwUELJKoPFl8TZrAydpzJiS-zq1hpzQsQula0lilkTEtghUgG-nJWU13GhdmDcMzzeZpfA6JjgJG3Pb09YXn2Qa5o Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:55:27.769697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd6083e6f18454781ae160d105c568e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}] Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 51cee82858d9446da50aab697dfcc3f3 Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Volume tempest-invalid-2016392931 could not be found. Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': 'tempest-invalid-2016392931'} Jul 25 08:55:27.772174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2016392931 could not be found. (HTTP 404) (Request-ID: req-ab007307-e82b-4d2e-8ba6-31546a07ed25) Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.773747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 08:55:27.776394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2016392931 could not be found. Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:27.778583 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2016392931 could not be found. Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2016392931 could not be found. Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0eff8c29-27ec-4aad-9c2b-86be54bef632 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Returning 404 to user: Volume tempest-invalid-2016392931 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0eff8c29-27ec-4aad-9c2b-86be54bef632 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2016392931" status: 404 len: 99 microversion: 2.1 time: 0.038275 Jul 25 08:55:27.780900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 514/994] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Jul 25 08:55:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2016392931 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 08:55:27.783606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-da009510-0fb4-41fc-9d14-cb1053912498 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004591 Jul 25 08:55:27.784128 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 481/995] 10.222.0.52 () {58 vars in 1140 bytes} [Mon Jul 25 08:55:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 25 08:55:27.792831 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2bd27daa-8647-4dcf-9e25-6a6840b79e0e tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003713 Jul 25 08:55:27.793248 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 515/996] 10.222.0.52 () {58 vars in 1137 bytes} [Mon Jul 25 08:55:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 25 08:55:27.805026 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d6a9b7c0-7136-4f62-8b36-d939b1822549 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Calling method '.version_select at 0x7f0f79b78280>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:27.837776 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-d6a9b7c0-7136-4f62-8b36-d939b1822549 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] HTTP exception thrown: Volume f810da1c-6f2c-4363-8cae-7343aa4621df could not be found. Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d6a9b7c0-7136-4f62-8b36-d939b1822549 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Request method failure captured: Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: DELETE /compute/v2.1/os-volumes/f810da1c-6f2c-4363-8cae-7343aa4621df HTTP/1.1 Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lp_ROyfoEZs80IlDsN573Qmp7rbYfs7a0ugkn-3N2AlVozYZvYt20GxReYbRTrL6KZARNTrHba2-jXEcdfYqQjwUELJKoPFl8TZrAydpzJiS-zq1hpzQsQula0lilkTEtghUgG-nJWU13GhdmDcMzzeZpfA6JjgJG3Pb09YXn2Qa5o Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:55:27.839742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd6083e6f18454781ae160d105c568e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}] Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 51cee82858d9446da50aab697dfcc3f3 Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Volume f810da1c-6f2c-4363-8cae-7343aa4621df could not be found. Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'f810da1c-6f2c-4363-8cae-7343aa4621df'} Jul 25 08:55:27.841339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f810da1c-6f2c-4363-8cae-7343aa4621df could not be found. (HTTP 404) (Request-ID: req-c9aaa25c-e48a-49c9-8e41-8782ee3f8712) Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.842588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 08:55:27.845180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f810da1c-6f2c-4363-8cae-7343aa4621df could not be found. Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 08:55:27.847789 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f810da1c-6f2c-4363-8cae-7343aa4621df could not be found. Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f810da1c-6f2c-4363-8cae-7343aa4621df could not be found. Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d6a9b7c0-7136-4f62-8b36-d939b1822549 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Returning 404 to user: Volume f810da1c-6f2c-4363-8cae-7343aa4621df could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d6a9b7c0-7136-4f62-8b36-d939b1822549 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/f810da1c-6f2c-4363-8cae-7343aa4621df" status: 404 len: 109 microversion: 2.1 time: 0.042860 Jul 25 08:55:27.850279 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 482/997] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Jul 25 08:55:27 2022] DELETE /compute/v2.1/os-volumes/f810da1c-6f2c-4363-8cae-7343aa4621df => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:55:27.851604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5ba362d8-389c-42cb-997c-3c800bf25b79 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Calling method '.version_select at 0x7f0f7995f670>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:27.879109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-5ba362d8-389c-42cb-997c-3c800bf25b79 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] HTTP exception thrown: Volume 7a2e16a0-a88b-432d-bb1e-85659bfb23e2 could not be found. Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5ba362d8-389c-42cb-997c-3c800bf25b79 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Request method failure captured: Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/os-volumes/7a2e16a0-a88b-432d-bb1e-85659bfb23e2 HTTP/1.1 Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lp_ROyfoEZs80IlDsN573Qmp7rbYfs7a0ugkn-3N2AlVozYZvYt20GxReYbRTrL6KZARNTrHba2-jXEcdfYqQjwUELJKoPFl8TZrAydpzJiS-zq1hpzQsQula0lilkTEtghUgG-nJWU13GhdmDcMzzeZpfA6JjgJG3Pb09YXn2Qa5o Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:55:27.883393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd6083e6f18454781ae160d105c568e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd6083e6f18454781ae160d105c568e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd6083e6f18454781ae160d105c568e"}]}] Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ebd6083e6f18454781ae160d105c568e Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesNegativeTest-868038359 Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 51cee82858d9446da50aab697dfcc3f3 Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesNegativeTest-868038359-project Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Volume 7a2e16a0-a88b-432d-bb1e-85659bfb23e2 could not be found. Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '7a2e16a0-a88b-432d-bb1e-85659bfb23e2'} Jul 25 08:55:27.884787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a2e16a0-a88b-432d-bb1e-85659bfb23e2 could not be found. (HTTP 404) (Request-ID: req-8b048b66-2140-42ae-9711-0ba747477d5e) Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.885704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 08:55:27.886906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a2e16a0-a88b-432d-bb1e-85659bfb23e2 could not be found. Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 08:55:27.888020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a2e16a0-a88b-432d-bb1e-85659bfb23e2 could not be found. Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a2e16a0-a88b-432d-bb1e-85659bfb23e2 could not be found. Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5ba362d8-389c-42cb-997c-3c800bf25b79 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] Returning 404 to user: Volume 7a2e16a0-a88b-432d-bb1e-85659bfb23e2 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5ba362d8-389c-42cb-997c-3c800bf25b79 tempest-VolumesNegativeTest-868038359 tempest-VolumesNegativeTest-868038359-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7a2e16a0-a88b-432d-bb1e-85659bfb23e2" status: 404 len: 109 microversion: 2.1 time: 0.037887 Jul 25 08:55:27.889205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 516/998] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:55:27 2022] GET /compute/v2.1/os-volumes/7a2e16a0-a88b-432d-bb1e-85659bfb23e2 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:55:34.728126 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e9f309d4-9f2d-49de-96bb-2f3187602ca5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:34.728763 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e9f309d4-9f2d-49de-96bb-2f3187602ca5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:34.735974 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e9f309d4-9f2d-49de-96bb-2f3187602ca5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:34.736432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e9f309d4-9f2d-49de-96bb-2f3187602ca5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:34.737246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e9f309d4-9f2d-49de-96bb-2f3187602ca5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:34.737688 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e9f309d4-9f2d-49de-96bb-2f3187602ca5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:34.761909 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e9f309d4-9f2d-49de-96bb-2f3187602ca5 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/ips" status: 200 len: 150 microversion: 2.1 time: 0.038326 Jul 25 08:55:34.762500 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 483/999] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Jul 25 08:55:34 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:36.116841 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ed3161b6-e7a5-4cc1-889d-e38c0f81d1bb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e5ee11e-48e8-4e2e-b798-b050b3f7484a"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:36.119228 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ed3161b6-e7a5-4cc1-889d-e38c0f81d1bb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:36.126225 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed3161b6-e7a5-4cc1-889d-e38c0f81d1bb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:36.126735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed3161b6-e7a5-4cc1-889d-e38c0f81d1bb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:36.127445 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed3161b6-e7a5-4cc1-889d-e38c0f81d1bb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:36.127880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed3161b6-e7a5-4cc1-889d-e38c0f81d1bb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:36.408719 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ed3161b6-e7a5-4cc1-889d-e38c0f81d1bb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296377 Jul 25 08:55:36.409352 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 517/1000] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:55:36 2022] POST /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:55:43.970105 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b49c26de-7316-4484-8277-289e6e1274c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e5ee11e-48e8-4e2e-b798-b050b3f7484a"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:43.972598 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b49c26de-7316-4484-8277-289e6e1274c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:43.979314 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b49c26de-7316-4484-8277-289e6e1274c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:43.979764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b49c26de-7316-4484-8277-289e6e1274c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:43.980527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b49c26de-7316-4484-8277-289e6e1274c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:43.980994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b49c26de-7316-4484-8277-289e6e1274c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:44.081950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-b49c26de-7316-4484-8277-289e6e1274c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Invalid volume: volume 4e5ee11e-48e8-4e2e-b798-b050b3f7484a is already attached to instances: c5c94565-b030-4cad-a705-425ace6d71ff Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b49c26de-7316-4484-8277-289e6e1274c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: POST /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments HTTP/1.1 Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 74 Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:55:44.083579 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {"volumeAttachment": {"volumeId": "4e5ee11e-48e8-4e2e-b798-b050b3f7484a"}} Jul 25 08:55:44.085130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Invalid volume: volume 4e5ee11e-48e8-4e2e-b798-b050b3f7484a is already attached to instances: c5c94565-b030-4cad-a705-425ace6d71ff Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'server_id': 'c5c94565-b030-4cad-a705-425ace6d71ff', 'body': {'volumeAttachment': {'volumeId': '4e5ee11e-48e8-4e2e-b798-b050b3f7484a'}}} Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4e5ee11e-48e8-4e2e-b798-b050b3f7484a is already attached to instances: c5c94565-b030-4cad-a705-425ace6d71ff Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:44.086022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4e5ee11e-48e8-4e2e-b798-b050b3f7484a is already attached to instances: c5c94565-b030-4cad-a705-425ace6d71ff Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:44.087205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:44.088430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:44.088430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:44.088430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:44.088430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4e5ee11e-48e8-4e2e-b798-b050b3f7484a is already attached to instances: c5c94565-b030-4cad-a705-425ace6d71ff Jul 25 08:55:44.088430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:44.088430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b49c26de-7316-4484-8277-289e6e1274c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 400 to user: Invalid volume: volume 4e5ee11e-48e8-4e2e-b798-b050b3f7484a is already attached to instances: c5c94565-b030-4cad-a705-425ace6d71ff {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:44.088430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b49c26de-7316-4484-8277-289e6e1274c9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119167 Jul 25 08:55:44.088430 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 484/1001] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:55:43 2022] POST /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 08:55:44.165612 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-640c274b-c8d5-4b20-a49a-7a7c65585850 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:44.166376 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-640c274b-c8d5-4b20-a49a-7a7c65585850 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:44.173617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-640c274b-c8d5-4b20-a49a-7a7c65585850 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:44.174070 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-640c274b-c8d5-4b20-a49a-7a7c65585850 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:44.174856 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-640c274b-c8d5-4b20-a49a-7a7c65585850 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:44.175295 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-640c274b-c8d5-4b20-a49a-7a7c65585850 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:44.269626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-640c274b-c8d5-4b20-a49a-7a7c65585850 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lazy-loading 'services' on Instance uuid c5c94565-b030-4cad-a705-425ace6d71ff {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:55:44.371720 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-640c274b-c8d5-4b20-a49a-7a7c65585850 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments/4e5ee11e-48e8-4e2e-b798-b050b3f7484a" status: 202 len: 0 microversion: 2.1 time: 0.211044 Jul 25 08:55:44.372326 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 518/1002] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:55:44 2022] DELETE /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments/4e5ee11e-48e8-4e2e-b798-b050b3f7484a => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:55:44.384055 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fc46afdb-f0a8-4849-81a4-1abe3fe98708 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:44.388319 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fc46afdb-f0a8-4849-81a4-1abe3fe98708 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:44.399148 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fc46afdb-f0a8-4849-81a4-1abe3fe98708 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:44.399913 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fc46afdb-f0a8-4849-81a4-1abe3fe98708 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:44.401153 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fc46afdb-f0a8-4849-81a4-1abe3fe98708 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:44.401765 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fc46afdb-f0a8-4849-81a4-1abe3fe98708 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:44.435213 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fc46afdb-f0a8-4849-81a4-1abe3fe98708 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058189 Jul 25 08:55:44.435810 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 485/1003] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:55:44 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:45.448887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-207e4860-b577-410b-b596-52b6401c4184 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:45.451826 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-207e4860-b577-410b-b596-52b6401c4184 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:45.458388 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-207e4860-b577-410b-b596-52b6401c4184 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:45.458853 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-207e4860-b577-410b-b596-52b6401c4184 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:45.459644 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-207e4860-b577-410b-b596-52b6401c4184 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:45.460085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-207e4860-b577-410b-b596-52b6401c4184 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:45.497525 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-207e4860-b577-410b-b596-52b6401c4184 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053496 Jul 25 08:55:45.498096 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 519/1004] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:55:45 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:55:45.567120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-543b988e-0908-4993-b235-18b475a9bb17 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:45.567829 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-543b988e-0908-4993-b235-18b475a9bb17 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:45.574542 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-543b988e-0908-4993-b235-18b475a9bb17 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:45.575050 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-543b988e-0908-4993-b235-18b475a9bb17 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:45.575874 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-543b988e-0908-4993-b235-18b475a9bb17 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:45.576345 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-543b988e-0908-4993-b235-18b475a9bb17 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:45.603325 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-543b988e-0908-4993-b235-18b475a9bb17 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:55:45.694150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-543b988e-0908-4993-b235-18b475a9bb17 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 204 len: 0 microversion: 2.1 time: 0.129550 Jul 25 08:55:45.695528 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 486/1005] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:55:45 2022] DELETE /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 08:55:45.705599 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-54d5db68-c74d-41e7-8a1e-102ca4b352ca tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:45.706209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-54d5db68-c74d-41e7-8a1e-102ca4b352ca tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:45.712362 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54d5db68-c74d-41e7-8a1e-102ca4b352ca tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:45.712851 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54d5db68-c74d-41e7-8a1e-102ca4b352ca tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:45.713623 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54d5db68-c74d-41e7-8a1e-102ca4b352ca tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:45.714060 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54d5db68-c74d-41e7-8a1e-102ca4b352ca tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:45.850310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-54d5db68-c74d-41e7-8a1e-102ca4b352ca tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:45.858130 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-54d5db68-c74d-41e7-8a1e-102ca4b352ca tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1681 microversion: 2.1 time: 0.156476 Jul 25 08:55:45.859280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 520/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:45 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:46.883125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-76b4900f-e462-4ece-b52e-1f00320bfc37 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:46.883959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-76b4900f-e462-4ece-b52e-1f00320bfc37 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:46.891382 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76b4900f-e462-4ece-b52e-1f00320bfc37 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:46.891947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76b4900f-e462-4ece-b52e-1f00320bfc37 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:46.892911 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76b4900f-e462-4ece-b52e-1f00320bfc37 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:46.893407 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76b4900f-e462-4ece-b52e-1f00320bfc37 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:47.222917 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-76b4900f-e462-4ece-b52e-1f00320bfc37 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:47.231414 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-76b4900f-e462-4ece-b52e-1f00320bfc37 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1681 microversion: 2.1 time: 0.353521 Jul 25 08:55:47.231942 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 487/1007] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:46 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:48.254399 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a0e2e3f3-0621-437d-8cb2-b35cd3800b83 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:48.255072 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a0e2e3f3-0621-437d-8cb2-b35cd3800b83 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:48.264161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e2e3f3-0621-437d-8cb2-b35cd3800b83 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:48.264922 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e2e3f3-0621-437d-8cb2-b35cd3800b83 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:48.266084 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e2e3f3-0621-437d-8cb2-b35cd3800b83 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:48.266778 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e2e3f3-0621-437d-8cb2-b35cd3800b83 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:48.454572 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a0e2e3f3-0621-437d-8cb2-b35cd3800b83 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:48.462211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a0e2e3f3-0621-437d-8cb2-b35cd3800b83 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1681 microversion: 2.1 time: 0.211671 Jul 25 08:55:48.462788 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 521/1008] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:48 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:49.338477 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-74a4fcdd-352f-44b1-9cd0-37bfd0f512b4 req-a08939b7-0d79-4b19-b7ac-2d0eb0ae71fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5c94565-b030-4cad-a705-425ace6d71ff", "name": "network-vif-deleted", "tag": "62088a84-476c-4db4-baa2-473b1dbbc579"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:49.353562 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-74a4fcdd-352f-44b1-9cd0-37bfd0f512b4 req-a08939b7-0d79-4b19-b7ac-2d0eb0ae71fe service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:49.354159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-74a4fcdd-352f-44b1-9cd0-37bfd0f512b4 req-a08939b7-0d79-4b19-b7ac-2d0eb0ae71fe service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:49.376281 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-74a4fcdd-352f-44b1-9cd0-37bfd0f512b4 req-a08939b7-0d79-4b19-b7ac-2d0eb0ae71fe service nova] Creating event network-vif-deleted:62088a84-476c-4db4-baa2-473b1dbbc579 for instance c5c94565-b030-4cad-a705-425ace6d71ff on hv-cinder-85084 Jul 25 08:55:49.384054 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-74a4fcdd-352f-44b1-9cd0-37bfd0f512b4 req-a08939b7-0d79-4b19-b7ac-2d0eb0ae71fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052897 Jul 25 08:55:49.391575 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 488/1009] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:55:49.483528 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:49.485253 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:49.493127 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:49.494572 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:49.496133 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:49.499275 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:49.540842 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:49.541921 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:49.542557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lazy-loading 'fault' on Instance uuid c5c94565-b030-4cad-a705-425ace6d71ff {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:55:49.595863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:49.604062 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-674ad9bc-666a-4bba-93e6-98443f1a2c50 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 200 len: 1330 microversion: 2.1 time: 0.124418 Jul 25 08:55:49.604666 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 522/1010] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:49 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:55:50.626546 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0efacc4d-97d4-47c7-a2fa-083f262596f7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:50.627150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0efacc4d-97d4-47c7-a2fa-083f262596f7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:50.633625 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0efacc4d-97d4-47c7-a2fa-083f262596f7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:50.634071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0efacc4d-97d4-47c7-a2fa-083f262596f7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:50.634840 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0efacc4d-97d4-47c7-a2fa-083f262596f7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:50.635270 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0efacc4d-97d4-47c7-a2fa-083f262596f7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:50.653208 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-0efacc4d-97d4-47c7-a2fa-083f262596f7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0efacc4d-97d4-47c7-a2fa-083f262596f7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff HTTP/1.1 Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:55:50.657161 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:55:50.659638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'c5c94565-b030-4cad-a705-425ace6d71ff'} Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:55:50.661733 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:55:50.663252 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:55:50.664432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0efacc4d-97d4-47c7-a2fa-083f262596f7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:55:50.664432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0efacc4d-97d4-47c7-a2fa-083f262596f7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 404 len: 111 microversion: 2.1 time: 0.037637 Jul 25 08:55:50.664432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 489/1011] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:50 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:55:50.672893 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-58662a4b-fd33-4139-ad01-7aaedec3b585 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '.version_select at 0x7f0f79a061f0>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:50.699073 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-58662a4b-fd33-4139-ad01-7aaedec3b585 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-972595416" status: 202 len: 0 microversion: 2.1 time: 0.032214 Jul 25 08:55:50.699585 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 523/1012] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Jul 25 08:55:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-972595416 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:55:51.336932 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-15082813-fb11-4783-8570-59af7818273f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: .version_select at 0x7f0f7982a4c0>, body: {"keypair": {"name": "tempest-keypair-616394325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvRkdzT1MmJ1XcL8VQjMnH6GKipFsvh+FU8cu0fGe/at3dZTOvpCLcHVd3niXzxlRDlSBcEkfxFyYc5Vib7WDlZJtUabcL9nSCbr9gcWpGp+GtvUpgwoPkdt2H68tO69A=="}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:51.356003 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-15082813-fb11-4783-8570-59af7818273f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:55:51.361671 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-15082813-fb11-4783-8570-59af7818273f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for user 8e682232b7374450a7265e092602a5a6 and project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:55:51.388243 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-15082813-fb11-4783-8570-59af7818273f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055203 Jul 25 08:55:51.388890 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 490/1013] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Jul 25 08:55:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:52.833582 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1219078797", "imageRef": "c54f5dfe-9b71-407e-a05b-b79208b21f5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ca11239-7898-4751-a9c6-3b03bbecba12"}], "security_groups": [{"name": "tempest-securitygroup--1239748867"}], "key_name": "tempest-keypair-616394325", "user_data": "}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:52.960900 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] validate_networks() for [('6ca11239-7898-4751-a9c6-3b03bbecba12', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:55:53.367347 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:55:53.367800 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:55:53.368281 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:55:53.368716 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:55:53.369570 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:55:53.378837 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:53.379466 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:53.380281 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:53.380760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:53.399114 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:55:53.403256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Getting quotas for user 8e682232b7374450a7265e092602a5a6 and project 86bea90252bc44b580c40b24b0bd4ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:55:53.416457 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:55:53.418802 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c54f5dfe-9b71-407e-a05b-b79208b21f5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:55:53.470040 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7c1ba77c-9f25-4d97-bec4-4a2799ace782 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.640773 Jul 25 08:55:53.470689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 524/1014] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:55:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 08:55:53.482176 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-064159df-1031-4bc2-871c-7bc2c4d0c362 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:53.482804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-064159df-1031-4bc2-871c-7bc2c4d0c362 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:53.542607 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-064159df-1031-4bc2-871c-7bc2c4d0c362 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:53.549821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-064159df-1031-4bc2-871c-7bc2c4d0c362 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1241 microversion: 2.1 time: 0.071998 Jul 25 08:55:53.550420 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 491/1015] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:53 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:55:54.571337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ba5ea222-1e22-4e56-a799-8f72c8437ebc tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:54.571921 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ba5ea222-1e22-4e56-a799-8f72c8437ebc tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:54.579051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba5ea222-1e22-4e56-a799-8f72c8437ebc tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:54.579502 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba5ea222-1e22-4e56-a799-8f72c8437ebc tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:54.580277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba5ea222-1e22-4e56-a799-8f72c8437ebc tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:54.581418 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba5ea222-1e22-4e56-a799-8f72c8437ebc tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:54.678429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ba5ea222-1e22-4e56-a799-8f72c8437ebc tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:54.685981 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ba5ea222-1e22-4e56-a799-8f72c8437ebc tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1301 microversion: 2.1 time: 0.119020 Jul 25 08:55:54.686775 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 525/1016] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:54 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1301 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:55.706992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-992704b9-95d6-4188-9fe4-8e39f87b8511 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:55.707714 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-992704b9-95d6-4188-9fe4-8e39f87b8511 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:55.714743 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-992704b9-95d6-4188-9fe4-8e39f87b8511 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:55.715283 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-992704b9-95d6-4188-9fe4-8e39f87b8511 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:55.716165 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-992704b9-95d6-4188-9fe4-8e39f87b8511 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:55.716702 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-992704b9-95d6-4188-9fe4-8e39f87b8511 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:55.877721 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-992704b9-95d6-4188-9fe4-8e39f87b8511 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:55.890881 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-992704b9-95d6-4188-9fe4-8e39f87b8511 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1367 microversion: 2.1 time: 0.186796 Jul 25 08:55:55.891806 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 492/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:55 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:56.117131 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-1b2f12aa-20bc-4345-8471-574bc2ea6096 req-87556fec-3101-40ba-810b-67c911a55f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94ab586a-09bb-4a39-8da0-2d4c003f5368", "tag": "582537f2-65a5-448b-a06c-d0ebf0814b75"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:55:56.132292 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1b2f12aa-20bc-4345-8471-574bc2ea6096 req-87556fec-3101-40ba-810b-67c911a55f02 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:56.133169 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1b2f12aa-20bc-4345-8471-574bc2ea6096 req-87556fec-3101-40ba-810b-67c911a55f02 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:56.147008 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-1b2f12aa-20bc-4345-8471-574bc2ea6096 req-87556fec-3101-40ba-810b-67c911a55f02 service nova] Creating event network-changed:582537f2-65a5-448b-a06c-d0ebf0814b75 for instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 on hv-cinder-85084 Jul 25 08:55:56.154046 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-1b2f12aa-20bc-4345-8471-574bc2ea6096 req-87556fec-3101-40ba-810b-67c911a55f02 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041239 Jul 25 08:55:56.156660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 526/1018] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:55:56.911469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-50a42fa6-45e7-4842-ad2a-9df1b91d21a9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:56.912107 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-50a42fa6-45e7-4842-ad2a-9df1b91d21a9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:56.918951 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50a42fa6-45e7-4842-ad2a-9df1b91d21a9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:56.919390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50a42fa6-45e7-4842-ad2a-9df1b91d21a9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:56.920168 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50a42fa6-45e7-4842-ad2a-9df1b91d21a9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:56.920617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-50a42fa6-45e7-4842-ad2a-9df1b91d21a9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:57.072220 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-50a42fa6-45e7-4842-ad2a-9df1b91d21a9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:57.080772 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-50a42fa6-45e7-4842-ad2a-9df1b91d21a9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1367 microversion: 2.1 time: 0.172956 Jul 25 08:55:57.081629 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 493/1019] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:56 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:58.102713 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ec12e6ea-c8b3-48e0-88cb-5744332aa4ec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:58.103444 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ec12e6ea-c8b3-48e0-88cb-5744332aa4ec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:58.111540 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec12e6ea-c8b3-48e0-88cb-5744332aa4ec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:58.111988 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec12e6ea-c8b3-48e0-88cb-5744332aa4ec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:58.112808 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec12e6ea-c8b3-48e0-88cb-5744332aa4ec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:58.113252 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec12e6ea-c8b3-48e0-88cb-5744332aa4ec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:58.246010 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ec12e6ea-c8b3-48e0-88cb-5744332aa4ec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:58.254607 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ec12e6ea-c8b3-48e0-88cb-5744332aa4ec tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1367 microversion: 2.1 time: 0.156399 Jul 25 08:55:58.255225 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 527/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:58 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:55:59.278442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7cb5d68f-90eb-49a4-8870-52bb6e4c6c21 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:55:59.279061 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7cb5d68f-90eb-49a4-8870-52bb6e4c6c21 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:55:59.286316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7cb5d68f-90eb-49a4-8870-52bb6e4c6c21 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:59.286770 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7cb5d68f-90eb-49a4-8870-52bb6e4c6c21 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:59.287578 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7cb5d68f-90eb-49a4-8870-52bb6e4c6c21 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:55:59.288017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7cb5d68f-90eb-49a4-8870-52bb6e4c6c21 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:55:59.293529 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:59.481979 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7cb5d68f-90eb-49a4-8870-52bb6e4c6c21 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:55:59.490899 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7cb5d68f-90eb-49a4-8870-52bb6e4c6c21 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1367 microversion: 2.1 time: 0.217424 Jul 25 08:55:59.492214 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 494/1021] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:55:59 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:56:00.518414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b9803bca-60d3-40a4-abef-6c4545e72fdb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:00.519095 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b9803bca-60d3-40a4-abef-6c4545e72fdb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:00.529494 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b9803bca-60d3-40a4-abef-6c4545e72fdb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:00.529943 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b9803bca-60d3-40a4-abef-6c4545e72fdb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:00.530805 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b9803bca-60d3-40a4-abef-6c4545e72fdb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:00.531188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b9803bca-60d3-40a4-abef-6c4545e72fdb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:00.704424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b9803bca-60d3-40a4-abef-6c4545e72fdb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:00.724957 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b9803bca-60d3-40a4-abef-6c4545e72fdb tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1367 microversion: 2.1 time: 0.201443 Jul 25 08:56:00.724957 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 528/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:56:00 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:56:01.739512 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-08b27115-d3d6-41b8-a8c8-bc44d26cd5c2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:01.740120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-08b27115-d3d6-41b8-a8c8-bc44d26cd5c2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:01.747463 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-08b27115-d3d6-41b8-a8c8-bc44d26cd5c2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:01.747909 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-08b27115-d3d6-41b8-a8c8-bc44d26cd5c2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:01.748726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-08b27115-d3d6-41b8-a8c8-bc44d26cd5c2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:01.749160 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-08b27115-d3d6-41b8-a8c8-bc44d26cd5c2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:01.897105 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-08b27115-d3d6-41b8-a8c8-bc44d26cd5c2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:01.909049 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-08b27115-d3d6-41b8-a8c8-bc44d26cd5c2 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1367 microversion: 2.1 time: 0.173294 Jul 25 08:56:01.909644 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 495/1023] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:56:01 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:56:02.858499 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-29857a59-b33b-41cc-b827-7c3070f1f1b7 req-40242402-4711-4921-8a57-97a445e96bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94ab586a-09bb-4a39-8da0-2d4c003f5368", "name": "network-vif-plugged", "status": "completed", "tag": "582537f2-65a5-448b-a06c-d0ebf0814b75"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:56:02.870008 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-29857a59-b33b-41cc-b827-7c3070f1f1b7 req-40242402-4711-4921-8a57-97a445e96bca service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:02.870381 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-29857a59-b33b-41cc-b827-7c3070f1f1b7 req-40242402-4711-4921-8a57-97a445e96bca service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:02.882520 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-29857a59-b33b-41cc-b827-7c3070f1f1b7 req-40242402-4711-4921-8a57-97a445e96bca service nova] Creating event network-vif-plugged:582537f2-65a5-448b-a06c-d0ebf0814b75 for instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 on hv-cinder-85084 Jul 25 08:56:02.888806 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-29857a59-b33b-41cc-b827-7c3070f1f1b7 req-40242402-4711-4921-8a57-97a445e96bca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035019 Jul 25 08:56:02.889531 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 529/1024] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:56:02.930571 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4d484557-148f-4b8f-8c25-7eb16ed5005c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:02.931410 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4d484557-148f-4b8f-8c25-7eb16ed5005c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:02.948670 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4d484557-148f-4b8f-8c25-7eb16ed5005c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:02.949209 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4d484557-148f-4b8f-8c25-7eb16ed5005c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:02.950885 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4d484557-148f-4b8f-8c25-7eb16ed5005c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:02.952213 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4d484557-148f-4b8f-8c25-7eb16ed5005c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:03.151101 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4d484557-148f-4b8f-8c25-7eb16ed5005c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:03.172165 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4d484557-148f-4b8f-8c25-7eb16ed5005c tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1367 microversion: 2.1 time: 0.243674 Jul 25 08:56:03.173113 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 496/1025] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:56:02 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:56:04.204071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:04.204999 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:04.210698 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fdc0a59c-97c0-4cc4-a24e-18cc6ec190e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:04.211463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fdc0a59c-97c0-4cc4-a24e-18cc6ec190e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:04.219996 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fdc0a59c-97c0-4cc4-a24e-18cc6ec190e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:04.220448 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fdc0a59c-97c0-4cc4-a24e-18cc6ec190e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:04.221252 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fdc0a59c-97c0-4cc4-a24e-18cc6ec190e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:04.221680 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fdc0a59c-97c0-4cc4-a24e-18cc6ec190e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:04.359479 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fdc0a59c-97c0-4cc4-a24e-18cc6ec190e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:04.367202 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fdc0a59c-97c0-4cc4-a24e-18cc6ec190e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1367 microversion: 2.1 time: 0.164173 Jul 25 08:56:04.367766 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 530/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:56:04 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:56:05.388919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-05b33534-f451-43d8-9abb-9f7bca8b8db4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:05.389566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-05b33534-f451-43d8-9abb-9f7bca8b8db4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:05.392100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=6 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:05.392793 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:05.398451 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-05b33534-f451-43d8-9abb-9f7bca8b8db4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:05.398901 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-05b33534-f451-43d8-9abb-9f7bca8b8db4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:05.399676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-05b33534-f451-43d8-9abb-9f7bca8b8db4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:05.400108 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-05b33534-f451-43d8-9abb-9f7bca8b8db4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:05.533361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-05b33534-f451-43d8-9abb-9f7bca8b8db4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:05.540917 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-05b33534-f451-43d8-9abb-9f7bca8b8db4 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1557 microversion: 2.1 time: 0.155889 Jul 25 08:56:05.541493 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 497/1027] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:56:05 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:56:05.561657 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ba409ecb-ab1f-49b4-9269-ae402d98c173 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:05.562207 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ba409ecb-ab1f-49b4-9269-ae402d98c173 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:05.568523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba409ecb-ab1f-49b4-9269-ae402d98c173 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:05.569004 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba409ecb-ab1f-49b4-9269-ae402d98c173 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:05.569754 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba409ecb-ab1f-49b4-9269-ae402d98c173 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:05.570185 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba409ecb-ab1f-49b4-9269-ae402d98c173 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:05.652999 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ba409ecb-ab1f-49b4-9269-ae402d98c173 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095213 Jul 25 08:56:05.653620 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 531/1028] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Jul 25 08:56:05 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:56:06.634120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-5a81927a-40c7-4991-904d-85fc800009cb req-3fc26437-4280-433d-b234-6cff69a06a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94ab586a-09bb-4a39-8da0-2d4c003f5368", "tag": "582537f2-65a5-448b-a06c-d0ebf0814b75"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:56:06.644343 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-5a81927a-40c7-4991-904d-85fc800009cb req-3fc26437-4280-433d-b234-6cff69a06a49 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:06.644810 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-5a81927a-40c7-4991-904d-85fc800009cb req-3fc26437-4280-433d-b234-6cff69a06a49 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:06.658032 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-5a81927a-40c7-4991-904d-85fc800009cb req-3fc26437-4280-433d-b234-6cff69a06a49 service nova] Creating event network-changed:582537f2-65a5-448b-a06c-d0ebf0814b75 for instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 on hv-cinder-85084 Jul 25 08:56:06.663429 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-5a81927a-40c7-4991-904d-85fc800009cb req-3fc26437-4280-433d-b234-6cff69a06a49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032901 Jul 25 08:56:06.664548 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 498/1029] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:56:45.626645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:45.627318 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:45.631293 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7f25bac3-212d-4175-a3f2-f6d941ecac7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:45.631886 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7f25bac3-212d-4175-a3f2-f6d941ecac7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:45.639433 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f25bac3-212d-4175-a3f2-f6d941ecac7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:45.639884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f25bac3-212d-4175-a3f2-f6d941ecac7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:45.641292 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f25bac3-212d-4175-a3f2-f6d941ecac7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:45.641723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7f25bac3-212d-4175-a3f2-f6d941ecac7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:45.667291 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7f25bac3-212d-4175-a3f2-f6d941ecac7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/ips" status: 200 len: 152 microversion: 2.20 time: 0.042698 Jul 25 08:56:45.667881 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 532/1030] 10.222.0.52 () {60 vars in 1289 bytes} [Mon Jul 25 08:56:45 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 08:56:47.305569 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=3 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:47.306277 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=25 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:47.310395 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7bec4e2c-fde7-4420-b893-475fc5057502 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:47.311011 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7bec4e2c-fde7-4420-b893-475fc5057502 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:47.318590 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7bec4e2c-fde7-4420-b893-475fc5057502 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:47.319039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7bec4e2c-fde7-4420-b893-475fc5057502 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:47.319807 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7bec4e2c-fde7-4420-b893-475fc5057502 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:47.320241 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7bec4e2c-fde7-4420-b893-475fc5057502 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:47.344197 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7bec4e2c-fde7-4420-b893-475fc5057502 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/ips" status: 200 len: 147 microversion: 2.1 time: 0.040427 Jul 25 08:56:47.344853 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 499/1031] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Jul 25 08:56:47 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:56:48.648402 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6babef70-96b8-4700-bec3-7bf51847ad12 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:56:48.648969 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6babef70-96b8-4700-bec3-7bf51847ad12 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:48.655734 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6babef70-96b8-4700-bec3-7bf51847ad12 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:48.656711 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6babef70-96b8-4700-bec3-7bf51847ad12 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:48.657578 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6babef70-96b8-4700-bec3-7bf51847ad12 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:48.658100 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6babef70-96b8-4700-bec3-7bf51847ad12 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:48.682760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-6babef70-96b8-4700-bec3-7bf51847ad12 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lazy-loading 'flavor' on Instance uuid 51f22e6c-5c89-42ee-90ce-a87e77bfa17b {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:56:48.882940 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6babef70-96b8-4700-bec3-7bf51847ad12 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "POST /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/action" status: 202 len: 0 microversion: 2.20 time: 0.238038 Jul 25 08:56:48.883402 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 533/1032] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Jul 25 08:56:48 2022] POST /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:56:48.891974 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9c8cb544-c7f8-4fb3-97b6-3ff82409952a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:48.892613 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9c8cb544-c7f8-4fb3-97b6-3ff82409952a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:48.899114 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c8cb544-c7f8-4fb3-97b6-3ff82409952a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:48.899649 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c8cb544-c7f8-4fb3-97b6-3ff82409952a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:48.900432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c8cb544-c7f8-4fb3-97b6-3ff82409952a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:48.900862 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9c8cb544-c7f8-4fb3-97b6-3ff82409952a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:49.052064 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9c8cb544-c7f8-4fb3-97b6-3ff82409952a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:49.060492 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9c8cb544-c7f8-4fb3-97b6-3ff82409952a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:49.062044 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9c8cb544-c7f8-4fb3-97b6-3ff82409952a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:49.063215 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9c8cb544-c7f8-4fb3-97b6-3ff82409952a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.175681 Jul 25 08:56:49.063777 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 500/1033] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:56:48 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:56:49.729545 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fa2d8f58-cd47-4fa4-8d71-35449665a296 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b7a8b57-b1db-4347-bc24-09c14f6d2f13"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:56:49.731957 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fa2d8f58-cd47-4fa4-8d71-35449665a296 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:49.739661 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa2d8f58-cd47-4fa4-8d71-35449665a296 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:49.740111 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa2d8f58-cd47-4fa4-8d71-35449665a296 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:49.740913 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa2d8f58-cd47-4fa4-8d71-35449665a296 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:49.741349 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa2d8f58-cd47-4fa4-8d71-35449665a296 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:50.012824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fa2d8f58-cd47-4fa4-8d71-35449665a296 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287868 Jul 25 08:56:50.013538 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 534/1034] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:56:49 2022] POST /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:56:50.087432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d47be4af-56f5-4d1c-87d9-45fd66dc45bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:50.088043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d47be4af-56f5-4d1c-87d9-45fd66dc45bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:50.095261 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d47be4af-56f5-4d1c-87d9-45fd66dc45bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:50.095588 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d47be4af-56f5-4d1c-87d9-45fd66dc45bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:50.096355 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d47be4af-56f5-4d1c-87d9-45fd66dc45bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:50.096827 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d47be4af-56f5-4d1c-87d9-45fd66dc45bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:50.233218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d47be4af-56f5-4d1c-87d9-45fd66dc45bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:50.245226 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d47be4af-56f5-4d1c-87d9-45fd66dc45bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:50.246737 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d47be4af-56f5-4d1c-87d9-45fd66dc45bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:50.247946 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d47be4af-56f5-4d1c-87d9-45fd66dc45bb tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.164617 Jul 25 08:56:50.248523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 501/1035] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:56:50 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:56:51.272416 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d4665cb9-483b-4562-ad07-e50a1da5d0e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:51.273126 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d4665cb9-483b-4562-ad07-e50a1da5d0e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:51.279462 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4665cb9-483b-4562-ad07-e50a1da5d0e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:51.279906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4665cb9-483b-4562-ad07-e50a1da5d0e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:51.280700 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4665cb9-483b-4562-ad07-e50a1da5d0e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:51.281172 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4665cb9-483b-4562-ad07-e50a1da5d0e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:51.416982 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d4665cb9-483b-4562-ad07-e50a1da5d0e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:51.425242 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d4665cb9-483b-4562-ad07-e50a1da5d0e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:51.426679 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d4665cb9-483b-4562-ad07-e50a1da5d0e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:51.427841 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d4665cb9-483b-4562-ad07-e50a1da5d0e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.160204 Jul 25 08:56:51.428440 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 535/1036] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:56:51 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:56:52.453086 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2d13784a-819a-4e47-b3d2-48d5e3ea9249 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:52.453744 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2d13784a-819a-4e47-b3d2-48d5e3ea9249 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:52.460670 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2d13784a-819a-4e47-b3d2-48d5e3ea9249 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:52.461339 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2d13784a-819a-4e47-b3d2-48d5e3ea9249 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:52.462110 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2d13784a-819a-4e47-b3d2-48d5e3ea9249 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:52.462541 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2d13784a-819a-4e47-b3d2-48d5e3ea9249 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:52.625825 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2d13784a-819a-4e47-b3d2-48d5e3ea9249 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:52.634399 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2d13784a-819a-4e47-b3d2-48d5e3ea9249 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:52.635912 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2d13784a-819a-4e47-b3d2-48d5e3ea9249 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:52.637187 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2d13784a-819a-4e47-b3d2-48d5e3ea9249 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.188019 Jul 25 08:56:52.637742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 502/1037] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:56:52 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:56:53.660679 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2e10df64-efac-43e8-910e-eefdd29e73ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:53.661319 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2e10df64-efac-43e8-910e-eefdd29e73ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:53.667861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e10df64-efac-43e8-910e-eefdd29e73ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:53.668308 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e10df64-efac-43e8-910e-eefdd29e73ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:53.669131 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e10df64-efac-43e8-910e-eefdd29e73ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:53.669566 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2e10df64-efac-43e8-910e-eefdd29e73ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:53.814408 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2e10df64-efac-43e8-910e-eefdd29e73ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:53.822403 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2e10df64-efac-43e8-910e-eefdd29e73ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:53.824074 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2e10df64-efac-43e8-910e-eefdd29e73ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:53.825281 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2e10df64-efac-43e8-910e-eefdd29e73ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.168462 Jul 25 08:56:53.825844 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 536/1038] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:56:53 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:56:54.851287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-69a672dd-d264-4aa6-aaea-14ffdbf7899a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:54.851287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-69a672dd-d264-4aa6-aaea-14ffdbf7899a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:54.857318 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69a672dd-d264-4aa6-aaea-14ffdbf7899a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:54.857318 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69a672dd-d264-4aa6-aaea-14ffdbf7899a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:54.857998 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69a672dd-d264-4aa6-aaea-14ffdbf7899a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:54.858630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69a672dd-d264-4aa6-aaea-14ffdbf7899a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:54.997227 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-69a672dd-d264-4aa6-aaea-14ffdbf7899a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:55.006270 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-69a672dd-d264-4aa6-aaea-14ffdbf7899a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:55.007781 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-69a672dd-d264-4aa6-aaea-14ffdbf7899a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:55.008984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-69a672dd-d264-4aa6-aaea-14ffdbf7899a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.164381 Jul 25 08:56:55.009557 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 503/1039] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:56:54 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:56:56.035722 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-45fb1f77-50b1-4a7a-9c5d-f51829dae864 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:56.036788 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-45fb1f77-50b1-4a7a-9c5d-f51829dae864 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:56.052151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-45fb1f77-50b1-4a7a-9c5d-f51829dae864 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:56.052151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-45fb1f77-50b1-4a7a-9c5d-f51829dae864 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:56.052151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-45fb1f77-50b1-4a7a-9c5d-f51829dae864 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:56.052151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-45fb1f77-50b1-4a7a-9c5d-f51829dae864 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:56.190831 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-45fb1f77-50b1-4a7a-9c5d-f51829dae864 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:56.199003 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-45fb1f77-50b1-4a7a-9c5d-f51829dae864 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:56.200494 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-45fb1f77-50b1-4a7a-9c5d-f51829dae864 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:56.201702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-45fb1f77-50b1-4a7a-9c5d-f51829dae864 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.173061 Jul 25 08:56:56.202225 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 537/1040] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:56:56 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:56:57.231098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f9c77540-92d1-400f-969a-f26cc5f680df tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:57.231718 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f9c77540-92d1-400f-969a-f26cc5f680df tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:57.239242 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f9c77540-92d1-400f-969a-f26cc5f680df tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:57.239703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f9c77540-92d1-400f-969a-f26cc5f680df tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:57.240492 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f9c77540-92d1-400f-969a-f26cc5f680df tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:57.240965 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f9c77540-92d1-400f-969a-f26cc5f680df tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:57.409073 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f9c77540-92d1-400f-969a-f26cc5f680df tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:57.420026 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f9c77540-92d1-400f-969a-f26cc5f680df tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:57.421572 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f9c77540-92d1-400f-969a-f26cc5f680df tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:57.423237 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f9c77540-92d1-400f-969a-f26cc5f680df tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.196267 Jul 25 08:56:57.423802 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 504/1041] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:56:57 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:56:57.586193 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8021f35d-44aa-4a9b-9a5c-dca937a29fa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:57.588793 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8021f35d-44aa-4a9b-9a5c-dca937a29fa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:57.599102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8021f35d-44aa-4a9b-9a5c-dca937a29fa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:57.599102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8021f35d-44aa-4a9b-9a5c-dca937a29fa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:57.599102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8021f35d-44aa-4a9b-9a5c-dca937a29fa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:57.599102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8021f35d-44aa-4a9b-9a5c-dca937a29fa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:57.631640 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8021f35d-44aa-4a9b-9a5c-dca937a29fa1 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049612 Jul 25 08:56:57.632414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 538/1042] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:56:57 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:56:57.643655 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3aaa1bbc-a22c-473f-9059-0969fa738498 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:57.644163 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3aaa1bbc-a22c-473f-9059-0969fa738498 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:57.650338 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3aaa1bbc-a22c-473f-9059-0969fa738498 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:57.650795 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3aaa1bbc-a22c-473f-9059-0969fa738498 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:57.651575 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3aaa1bbc-a22c-473f-9059-0969fa738498 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:57.652002 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3aaa1bbc-a22c-473f-9059-0969fa738498 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:57.684843 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3aaa1bbc-a22c-473f-9059-0969fa738498 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments/6b7a8b57-b1db-4347-bc24-09c14f6d2f13" status: 200 len: 194 microversion: 2.1 time: 0.045810 Jul 25 08:56:57.685557 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 505/1043] 10.222.0.52 () {58 vars in 1413 bytes} [Mon Jul 25 08:56:57 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments/6b7a8b57-b1db-4347-bc24-09c14f6d2f13 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:56:58.447929 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-acdaf15f-b397-4036-b5d5-413170c78d46 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:58.448804 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-acdaf15f-b397-4036-b5d5-413170c78d46 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:58.455784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-acdaf15f-b397-4036-b5d5-413170c78d46 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:58.455784 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-acdaf15f-b397-4036-b5d5-413170c78d46 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:58.456497 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-acdaf15f-b397-4036-b5d5-413170c78d46 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:58.456960 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-acdaf15f-b397-4036-b5d5-413170c78d46 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:58.600308 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-acdaf15f-b397-4036-b5d5-413170c78d46 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:58.608660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-acdaf15f-b397-4036-b5d5-413170c78d46 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:58.610287 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-acdaf15f-b397-4036-b5d5-413170c78d46 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:58.611536 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-acdaf15f-b397-4036-b5d5-413170c78d46 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.167862 Jul 25 08:56:58.612447 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 539/1044] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:56:58 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:56:59.081712 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-996af9b1-59c3-4523-b34a-8f172e3307b7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c6fa79b-6cf7-4908-ae2c-8c872461e896"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:56:59.085459 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-996af9b1-59c3-4523-b34a-8f172e3307b7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:59.093320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-996af9b1-59c3-4523-b34a-8f172e3307b7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:59.094117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-996af9b1-59c3-4523-b34a-8f172e3307b7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:59.095072 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-996af9b1-59c3-4523-b34a-8f172e3307b7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:59.095722 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-996af9b1-59c3-4523-b34a-8f172e3307b7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:59.408457 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-996af9b1-59c3-4523-b34a-8f172e3307b7 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "POST /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337295 Jul 25 08:56:59.415332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 506/1045] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:56:59 2022] POST /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:56:59.636880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-12a0f9f9-c169-46a8-bd66-a3496bd97ce4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:56:59.637654 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-12a0f9f9-c169-46a8-bd66-a3496bd97ce4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:56:59.648367 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12a0f9f9-c169-46a8-bd66-a3496bd97ce4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:59.648850 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12a0f9f9-c169-46a8-bd66-a3496bd97ce4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:59.649630 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12a0f9f9-c169-46a8-bd66-a3496bd97ce4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:56:59.650288 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12a0f9f9-c169-46a8-bd66-a3496bd97ce4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:56:59.806393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-12a0f9f9-c169-46a8-bd66-a3496bd97ce4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:59.817858 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-12a0f9f9-c169-46a8-bd66-a3496bd97ce4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:59.819438 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-12a0f9f9-c169-46a8-bd66-a3496bd97ce4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:56:59.820641 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-12a0f9f9-c169-46a8-bd66-a3496bd97ce4 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.187881 Jul 25 08:56:59.821194 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 540/1046] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:56:59 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:00.849702 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bf4cea77-4975-4fa3-81a4-cef7c976d588 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:00.852419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bf4cea77-4975-4fa3-81a4-cef7c976d588 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:00.860330 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf4cea77-4975-4fa3-81a4-cef7c976d588 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:00.861081 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf4cea77-4975-4fa3-81a4-cef7c976d588 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:00.861870 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf4cea77-4975-4fa3-81a4-cef7c976d588 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:00.862310 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bf4cea77-4975-4fa3-81a4-cef7c976d588 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:01.311552 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bf4cea77-4975-4fa3-81a4-cef7c976d588 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:01.320358 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bf4cea77-4975-4fa3-81a4-cef7c976d588 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:01.321931 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bf4cea77-4975-4fa3-81a4-cef7c976d588 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:01.323319 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bf4cea77-4975-4fa3-81a4-cef7c976d588 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1745 microversion: 2.20 time: 0.480007 Jul 25 08:57:01.335211 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 507/1047] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:00 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1745 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:02.355675 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a5d4a2dc-7bd7-45e1-85c0-3a0ae0d8ca82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:02.357906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a5d4a2dc-7bd7-45e1-85c0-3a0ae0d8ca82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:02.370914 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5d4a2dc-7bd7-45e1-85c0-3a0ae0d8ca82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:02.372469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5d4a2dc-7bd7-45e1-85c0-3a0ae0d8ca82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:02.374469 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5d4a2dc-7bd7-45e1-85c0-3a0ae0d8ca82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:02.376353 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5d4a2dc-7bd7-45e1-85c0-3a0ae0d8ca82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:02.574044 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a5d4a2dc-7bd7-45e1-85c0-3a0ae0d8ca82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:02.584022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a5d4a2dc-7bd7-45e1-85c0-3a0ae0d8ca82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:02.586643 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a5d4a2dc-7bd7-45e1-85c0-3a0ae0d8ca82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:02.588246 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a5d4a2dc-7bd7-45e1-85c0-3a0ae0d8ca82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1745 microversion: 2.20 time: 0.243889 Jul 25 08:57:02.605732 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 541/1048] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:02 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1745 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:03.611479 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-81899a20-1f81-4be2-b516-50a92c148ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:03.612095 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-81899a20-1f81-4be2-b516-50a92c148ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:03.619362 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-81899a20-1f81-4be2-b516-50a92c148ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:03.620076 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-81899a20-1f81-4be2-b516-50a92c148ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:03.621295 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-81899a20-1f81-4be2-b516-50a92c148ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:03.621832 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-81899a20-1f81-4be2-b516-50a92c148ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:03.833572 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-81899a20-1f81-4be2-b516-50a92c148ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:03.849605 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-81899a20-1f81-4be2-b516-50a92c148ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:03.851606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-81899a20-1f81-4be2-b516-50a92c148ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:03.853131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-81899a20-1f81-4be2-b516-50a92c148ded tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1745 microversion: 2.20 time: 0.245591 Jul 25 08:57:03.854082 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 508/1049] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:03 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1745 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:04.879809 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0e8d0416-650a-4040-8ff8-f7b618324426 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:04.880760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0e8d0416-650a-4040-8ff8-f7b618324426 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:04.896439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e8d0416-650a-4040-8ff8-f7b618324426 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:04.897087 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e8d0416-650a-4040-8ff8-f7b618324426 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:04.903334 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e8d0416-650a-4040-8ff8-f7b618324426 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:04.903846 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e8d0416-650a-4040-8ff8-f7b618324426 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:05.099856 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0e8d0416-650a-4040-8ff8-f7b618324426 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:05.111068 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0e8d0416-650a-4040-8ff8-f7b618324426 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:05.113717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0e8d0416-650a-4040-8ff8-f7b618324426 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:05.115378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0e8d0416-650a-4040-8ff8-f7b618324426 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1745 microversion: 2.20 time: 0.240580 Jul 25 08:57:05.116342 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 542/1050] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:04 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:05.697860 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-cb81ba6c-633b-4770-a9aa-fd087048bdf3 req-a01f133c-d57d-4ba5-926b-d9cb554f645b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f22e6c-5c89-42ee-90ce-a87e77bfa17b", "name": "network-vif-plugged", "status": "completed", "tag": "68b8d737-1cd3-4135-ad4b-35b7ce49fc3d"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:57:05.708950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-cb81ba6c-633b-4770-a9aa-fd087048bdf3 req-a01f133c-d57d-4ba5-926b-d9cb554f645b service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:05.709395 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-cb81ba6c-633b-4770-a9aa-fd087048bdf3 req-a01f133c-d57d-4ba5-926b-d9cb554f645b service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:05.722630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-cb81ba6c-633b-4770-a9aa-fd087048bdf3 req-a01f133c-d57d-4ba5-926b-d9cb554f645b service nova] Creating event network-vif-plugged:68b8d737-1cd3-4135-ad4b-35b7ce49fc3d for instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b on hv-cinder-85084 Jul 25 08:57:05.736912 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-cb81ba6c-633b-4770-a9aa-fd087048bdf3 req-a01f133c-d57d-4ba5-926b-d9cb554f645b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.414683 Jul 25 08:57:05.738920 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 509/1051] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:57:06.147272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3cdeb4f8-c654-459d-9d4d-20811e4b2416 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:06.148741 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3cdeb4f8-c654-459d-9d4d-20811e4b2416 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:06.157722 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cdeb4f8-c654-459d-9d4d-20811e4b2416 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:06.160229 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cdeb4f8-c654-459d-9d4d-20811e4b2416 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:06.161586 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cdeb4f8-c654-459d-9d4d-20811e4b2416 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:06.162248 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cdeb4f8-c654-459d-9d4d-20811e4b2416 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:06.319904 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3cdeb4f8-c654-459d-9d4d-20811e4b2416 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:06.329177 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3cdeb4f8-c654-459d-9d4d-20811e4b2416 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:06.330702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3cdeb4f8-c654-459d-9d4d-20811e4b2416 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:06.331916 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3cdeb4f8-c654-459d-9d4d-20811e4b2416 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1745 microversion: 2.20 time: 0.188710 Jul 25 08:57:06.332656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 543/1052] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:06 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:07.358874 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-92954041-b77d-4e00-96aa-612b537d8880 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:07.360172 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-92954041-b77d-4e00-96aa-612b537d8880 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:07.387150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-92954041-b77d-4e00-96aa-612b537d8880 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:07.387613 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-92954041-b77d-4e00-96aa-612b537d8880 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:07.388678 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-92954041-b77d-4e00-96aa-612b537d8880 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:07.389127 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-92954041-b77d-4e00-96aa-612b537d8880 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:07.610764 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-92954041-b77d-4e00-96aa-612b537d8880 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:07.622025 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-92954041-b77d-4e00-96aa-612b537d8880 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:07.624111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-92954041-b77d-4e00-96aa-612b537d8880 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:07.625982 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-92954041-b77d-4e00-96aa-612b537d8880 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1745 microversion: 2.20 time: 0.274301 Jul 25 08:57:07.627071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 510/1053] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:07 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1745 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:08.355865 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8bf48f08-0fb4-4d6a-8222-38732e06b615 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:08.358329 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8bf48f08-0fb4-4d6a-8222-38732e06b615 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:08.366406 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bf48f08-0fb4-4d6a-8222-38732e06b615 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:08.367147 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bf48f08-0fb4-4d6a-8222-38732e06b615 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:08.368281 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bf48f08-0fb4-4d6a-8222-38732e06b615 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:08.369185 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bf48f08-0fb4-4d6a-8222-38732e06b615 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:08.429726 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8bf48f08-0fb4-4d6a-8222-38732e06b615 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.080992 Jul 25 08:57:08.430608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 544/1054] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:57:08 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:57:08.579531 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7594c9c4-bf2d-4c91-b88d-5aef52c4ebd9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:08.580069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7594c9c4-bf2d-4c91-b88d-5aef52c4ebd9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:08.589944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7594c9c4-bf2d-4c91-b88d-5aef52c4ebd9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:08.592342 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7594c9c4-bf2d-4c91-b88d-5aef52c4ebd9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:08.593388 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7594c9c4-bf2d-4c91-b88d-5aef52c4ebd9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:08.594792 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7594c9c4-bf2d-4c91-b88d-5aef52c4ebd9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:08.632726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7594c9c4-bf2d-4c91-b88d-5aef52c4ebd9 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments/6b7a8b57-b1db-4347-bc24-09c14f6d2f13" status: 200 len: 194 microversion: 2.1 time: 0.059468 Jul 25 08:57:08.634529 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 511/1055] 10.222.0.52 () {58 vars in 1413 bytes} [Mon Jul 25 08:57:08 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments/6b7a8b57-b1db-4347-bc24-09c14f6d2f13 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:57:08.646785 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6d3df385-6194-4acf-9e24-d2f299ec1a62 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:08.647653 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6d3df385-6194-4acf-9e24-d2f299ec1a62 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:08.651101 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b3a90743-36de-46d9-a800-09ea0f3a1c7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:08.651732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b3a90743-36de-46d9-a800-09ea0f3a1c7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:08.661666 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b3a90743-36de-46d9-a800-09ea0f3a1c7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:08.662332 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b3a90743-36de-46d9-a800-09ea0f3a1c7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:08.663399 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b3a90743-36de-46d9-a800-09ea0f3a1c7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:08.664184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b3a90743-36de-46d9-a800-09ea0f3a1c7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:08.665112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d3df385-6194-4acf-9e24-d2f299ec1a62 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:08.665968 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d3df385-6194-4acf-9e24-d2f299ec1a62 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:08.667648 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d3df385-6194-4acf-9e24-d2f299ec1a62 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:08.668366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d3df385-6194-4acf-9e24-d2f299ec1a62 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:08.696932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:08.830100 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-6d3df385-6194-4acf-9e24-d2f299ec1a62 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lazy-loading 'services' on Instance uuid e48872a7-8219-4458-8832-bc33f66c0250 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:57:08.892298 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b3a90743-36de-46d9-a800-09ea0f3a1c7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:08.901370 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b3a90743-36de-46d9-a800-09ea0f3a1c7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:08.903132 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b3a90743-36de-46d9-a800-09ea0f3a1c7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:08.904602 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b3a90743-36de-46d9-a800-09ea0f3a1c7d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1745 microversion: 2.20 time: 0.258058 Jul 25 08:57:08.905552 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 512/1056] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:08 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1745 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:57:08.944804 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6d3df385-6194-4acf-9e24-d2f299ec1a62 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments/6b7a8b57-b1db-4347-bc24-09c14f6d2f13" status: 202 len: 0 microversion: 2.1 time: 0.303492 Jul 25 08:57:08.946805 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 545/1057] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:57:08 2022] DELETE /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments/6b7a8b57-b1db-4347-bc24-09c14f6d2f13 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:57:09.137637 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-60af4ec0-54c0-4fa2-89f3-b4bbbce7448c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Action: 'create', calling method: .version_select at 0x7f0f79afc3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1342922356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBqg9BKxgmThWqvWhZJqTChc0d+2MVCZgJhaWn3KBBjCoOXgpWI2YPHeT6QAu2u3Jo5EXGaRkgC9DB18aqWLiaaRkONpB/HQzluZqD//PuutAScmXIkS848t/Q5mJW+SQ=="}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:57:09.157943 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-60af4ec0-54c0-4fa2-89f3-b4bbbce7448c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Getting quotas for project 5005a107ff1940908069356c788185f6. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:57:09.163758 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-60af4ec0-54c0-4fa2-89f3-b4bbbce7448c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Getting quotas for user a1a3d224feb94a1baa75a03bc8d1132a and project 5005a107ff1940908069356c788185f6. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:57:09.188393 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-60af4ec0-54c0-4fa2-89f3-b4bbbce7448c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.162451 Jul 25 08:57:09.189051 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 513/1058] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Jul 25 08:57:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:57:09.929331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-01ed3c24-18dc-4c8b-9029-cc17b7eac08e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:09.930035 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-01ed3c24-18dc-4c8b-9029-cc17b7eac08e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:09.937314 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-01ed3c24-18dc-4c8b-9029-cc17b7eac08e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:09.937770 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-01ed3c24-18dc-4c8b-9029-cc17b7eac08e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:09.938638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-01ed3c24-18dc-4c8b-9029-cc17b7eac08e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:09.939086 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-01ed3c24-18dc-4c8b-9029-cc17b7eac08e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:10.199780 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-01ed3c24-18dc-4c8b-9029-cc17b7eac08e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:10.209868 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-01ed3c24-18dc-4c8b-9029-cc17b7eac08e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:10.212217 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-01ed3c24-18dc-4c8b-9029-cc17b7eac08e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:10.214318 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-01ed3c24-18dc-4c8b-9029-cc17b7eac08e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1745 microversion: 2.20 time: 0.289439 Jul 25 08:57:10.229738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 546/1059] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:09 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1745 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:11.181081 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-33733ce8-e3e0-485e-a5ca-9497d92318ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:11.181804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-33733ce8-e3e0-485e-a5ca-9497d92318ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:11.189048 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-33733ce8-e3e0-485e-a5ca-9497d92318ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:11.189504 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-33733ce8-e3e0-485e-a5ca-9497d92318ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:11.190302 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-33733ce8-e3e0-485e-a5ca-9497d92318ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:11.190754 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-33733ce8-e3e0-485e-a5ca-9497d92318ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:11.223345 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-33733ce8-e3e0-485e-a5ca-9497d92318ac tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments/4c6fa79b-6cf7-4908-ae2c-8c872461e896" status: 200 len: 194 microversion: 2.1 time: 0.047580 Jul 25 08:57:11.223851 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 514/1060] 10.222.0.52 () {58 vars in 1413 bytes} [Mon Jul 25 08:57:11 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments/4c6fa79b-6cf7-4908-ae2c-8c872461e896 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:57:11.234794 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8a54354a-1d23-4d90-ba0c-b76fddcb2ad0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:11.235887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8a54354a-1d23-4d90-ba0c-b76fddcb2ad0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:11.240989 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-8f8b6e71-a096-4243-8eb7-e8dabb28f909 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:11.241883 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-8f8b6e71-a096-4243-8eb7-e8dabb28f909 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:11.246919 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a54354a-1d23-4d90-ba0c-b76fddcb2ad0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:11.247373 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a54354a-1d23-4d90-ba0c-b76fddcb2ad0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:11.250897 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a54354a-1d23-4d90-ba0c-b76fddcb2ad0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:11.252371 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8f8b6e71-a096-4243-8eb7-e8dabb28f909 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:11.253369 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a54354a-1d23-4d90-ba0c-b76fddcb2ad0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:11.254034 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8f8b6e71-a096-4243-8eb7-e8dabb28f909 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:11.256049 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8f8b6e71-a096-4243-8eb7-e8dabb28f909 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:11.256826 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-8f8b6e71-a096-4243-8eb7-e8dabb28f909 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:11.367017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-8a54354a-1d23-4d90-ba0c-b76fddcb2ad0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lazy-loading 'services' on Instance uuid e48872a7-8219-4458-8832-bc33f66c0250 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:57:11.503940 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8f8b6e71-a096-4243-8eb7-e8dabb28f909 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:11.510184 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8a54354a-1d23-4d90-ba0c-b76fddcb2ad0 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments/4c6fa79b-6cf7-4908-ae2c-8c872461e896" status: 202 len: 0 microversion: 2.1 time: 0.279361 Jul 25 08:57:11.511097 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 547/1061] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:57:11 2022] DELETE /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments/4c6fa79b-6cf7-4908-ae2c-8c872461e896 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:57:11.539679 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8f8b6e71-a096-4243-8eb7-e8dabb28f909 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:11.543042 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-8f8b6e71-a096-4243-8eb7-e8dabb28f909 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:11.544298 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-8f8b6e71-a096-4243-8eb7-e8dabb28f909 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.308474 Jul 25 08:57:11.548318 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 515/1062] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:11 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:57:12.569613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b4536d3f-0485-4735-a6fb-e6b9792a6e7b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:12.571003 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b4536d3f-0485-4735-a6fb-e6b9792a6e7b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:12.602437 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4536d3f-0485-4735-a6fb-e6b9792a6e7b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:12.603147 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4536d3f-0485-4735-a6fb-e6b9792a6e7b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:12.603685 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4536d3f-0485-4735-a6fb-e6b9792a6e7b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:12.604124 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4536d3f-0485-4735-a6fb-e6b9792a6e7b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:12.775456 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-87c037e7-b4b9-4e73-b7bf-f02e51f1c772 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:12.777939 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-87c037e7-b4b9-4e73-b7bf-f02e51f1c772 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:12.788112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-87c037e7-b4b9-4e73-b7bf-f02e51f1c772 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:12.788990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-87c037e7-b4b9-4e73-b7bf-f02e51f1c772 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:12.790099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-87c037e7-b4b9-4e73-b7bf-f02e51f1c772 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:12.790703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-87c037e7-b4b9-4e73-b7bf-f02e51f1c772 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:12.798345 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:12.832687 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b4536d3f-0485-4735-a6fb-e6b9792a6e7b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:12.850223 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-87c037e7-b4b9-4e73-b7bf-f02e51f1c772 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078959 Jul 25 08:57:12.853483 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b4536d3f-0485-4735-a6fb-e6b9792a6e7b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:12.858828 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b4536d3f-0485-4735-a6fb-e6b9792a6e7b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:12.861818 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b4536d3f-0485-4735-a6fb-e6b9792a6e7b tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.296196 Jul 25 08:57:12.876004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 516/1063] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:57:12 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:57:12.876548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 548/1064] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:12 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:13.038019 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c2a2f6db-e148-46fa-8842-30c6921773d2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:13.040717 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c2a2f6db-e148-46fa-8842-30c6921773d2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:13.057701 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c2a2f6db-e148-46fa-8842-30c6921773d2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:13.058094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c2a2f6db-e148-46fa-8842-30c6921773d2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:13.058882 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c2a2f6db-e148-46fa-8842-30c6921773d2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:13.059337 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c2a2f6db-e148-46fa-8842-30c6921773d2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:13.096851 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c2a2f6db-e148-46fa-8842-30c6921773d2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062079 Jul 25 08:57:13.126376 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 517/1065] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:57:13 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:57:13.196456 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-183bcdb3-db6f-4b98-b1c3-818760e928c8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:13.196994 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-183bcdb3-db6f-4b98-b1c3-818760e928c8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:13.204494 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-183bcdb3-db6f-4b98-b1c3-818760e928c8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:13.205174 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-183bcdb3-db6f-4b98-b1c3-818760e928c8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:13.206035 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-183bcdb3-db6f-4b98-b1c3-818760e928c8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:13.206482 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-183bcdb3-db6f-4b98-b1c3-818760e928c8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:13.271465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-183bcdb3-db6f-4b98-b1c3-818760e928c8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:57:13.486799 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-183bcdb3-db6f-4b98-b1c3-818760e928c8 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 204 len: 0 microversion: 2.1 time: 0.295418 Jul 25 08:57:13.487394 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 549/1066] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:57:13 2022] DELETE /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:57:13.496973 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e286ddba-7369-4380-a986-ce64467c323e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:13.498012 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e286ddba-7369-4380-a986-ce64467c323e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:13.509070 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e286ddba-7369-4380-a986-ce64467c323e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:13.518891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e286ddba-7369-4380-a986-ce64467c323e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:13.520112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e286ddba-7369-4380-a986-ce64467c323e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:13.520841 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e286ddba-7369-4380-a986-ce64467c323e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:13.821308 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e286ddba-7369-4380-a986-ce64467c323e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:13.833350 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e286ddba-7369-4380-a986-ce64467c323e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1675 microversion: 2.1 time: 0.341365 Jul 25 08:57:13.834887 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 518/1067] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:13 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1675 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:13.891437 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4e0f4234-d7a0-4bf0-95e0-63cc81c60396 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:13.892848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4e0f4234-d7a0-4bf0-95e0-63cc81c60396 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:13.900776 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e0f4234-d7a0-4bf0-95e0-63cc81c60396 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:13.901521 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e0f4234-d7a0-4bf0-95e0-63cc81c60396 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:13.902480 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e0f4234-d7a0-4bf0-95e0-63cc81c60396 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:13.903082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e0f4234-d7a0-4bf0-95e0-63cc81c60396 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:14.137588 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4e0f4234-d7a0-4bf0-95e0-63cc81c60396 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:14.152472 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4e0f4234-d7a0-4bf0-95e0-63cc81c60396 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:14.154749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4e0f4234-d7a0-4bf0-95e0-63cc81c60396 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:14.156447 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4e0f4234-d7a0-4bf0-95e0-63cc81c60396 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.272734 Jul 25 08:57:14.157645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 550/1068] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:13 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:14.855895 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dd3a71d1-63de-4a81-9508-7b69482d5b28 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:14.856471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dd3a71d1-63de-4a81-9508-7b69482d5b28 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:14.867088 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dd3a71d1-63de-4a81-9508-7b69482d5b28 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:14.868117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dd3a71d1-63de-4a81-9508-7b69482d5b28 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:14.869347 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dd3a71d1-63de-4a81-9508-7b69482d5b28 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:14.870047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dd3a71d1-63de-4a81-9508-7b69482d5b28 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:15.014523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dd3a71d1-63de-4a81-9508-7b69482d5b28 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:15.023337 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dd3a71d1-63de-4a81-9508-7b69482d5b28 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1675 microversion: 2.1 time: 0.171527 Jul 25 08:57:15.024020 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 519/1069] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:14 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:15.184999 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-42a3bccb-3a25-4f21-86a8-73869fdd96b1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:15.186832 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-42a3bccb-3a25-4f21-86a8-73869fdd96b1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:15.194098 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-42a3bccb-3a25-4f21-86a8-73869fdd96b1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:15.194877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-42a3bccb-3a25-4f21-86a8-73869fdd96b1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:15.195724 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-42a3bccb-3a25-4f21-86a8-73869fdd96b1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:15.196232 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-42a3bccb-3a25-4f21-86a8-73869fdd96b1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:15.376890 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-42a3bccb-3a25-4f21-86a8-73869fdd96b1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:15.390368 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-42a3bccb-3a25-4f21-86a8-73869fdd96b1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:15.393004 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-42a3bccb-3a25-4f21-86a8-73869fdd96b1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:15.395082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-42a3bccb-3a25-4f21-86a8-73869fdd96b1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.214201 Jul 25 08:57:15.415688 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 551/1070] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:15 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:16.045857 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1e2c5d5b-823b-4b62-b60c-0a1d09d12d31 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:16.047492 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1e2c5d5b-823b-4b62-b60c-0a1d09d12d31 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:16.061852 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1e2c5d5b-823b-4b62-b60c-0a1d09d12d31 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:16.067516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1e2c5d5b-823b-4b62-b60c-0a1d09d12d31 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:16.070268 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1e2c5d5b-823b-4b62-b60c-0a1d09d12d31 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:16.072106 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1e2c5d5b-823b-4b62-b60c-0a1d09d12d31 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:16.317946 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1e2c5d5b-823b-4b62-b60c-0a1d09d12d31 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:16.326361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1e2c5d5b-823b-4b62-b60c-0a1d09d12d31 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1675 microversion: 2.1 time: 0.284786 Jul 25 08:57:16.327597 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 520/1071] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:16 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1675 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:16.438428 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f9c72e74-34fe-4500-996c-9e07a9afb087 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:16.439057 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f9c72e74-34fe-4500-996c-9e07a9afb087 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:16.442347 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:16.460609 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f9c72e74-34fe-4500-996c-9e07a9afb087 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:16.461071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f9c72e74-34fe-4500-996c-9e07a9afb087 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:16.461869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f9c72e74-34fe-4500-996c-9e07a9afb087 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:16.462303 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f9c72e74-34fe-4500-996c-9e07a9afb087 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:16.667346 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f9c72e74-34fe-4500-996c-9e07a9afb087 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:16.682714 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f9c72e74-34fe-4500-996c-9e07a9afb087 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:16.682714 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f9c72e74-34fe-4500-996c-9e07a9afb087 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:16.682714 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f9c72e74-34fe-4500-996c-9e07a9afb087 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.260858 Jul 25 08:57:16.683327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 552/1072] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:16 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:17.260076 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-5af8c4c6-d5fe-4589-a12a-fb7a07972f7b req-5df19797-3802-4d76-8732-932bb0b5a3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48872a7-8219-4458-8832-bc33f66c0250", "name": "network-vif-deleted", "tag": "8d036e4d-eb5b-4629-9fa0-863090220d9c"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:57:17.275690 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-5af8c4c6-d5fe-4589-a12a-fb7a07972f7b req-5df19797-3802-4d76-8732-932bb0b5a3bf service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:17.276147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-5af8c4c6-d5fe-4589-a12a-fb7a07972f7b req-5df19797-3802-4d76-8732-932bb0b5a3bf service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:17.315163 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-5af8c4c6-d5fe-4589-a12a-fb7a07972f7b req-5df19797-3802-4d76-8732-932bb0b5a3bf service nova] Creating event network-vif-deleted:8d036e4d-eb5b-4629-9fa0-863090220d9c for instance e48872a7-8219-4458-8832-bc33f66c0250 on hv-cinder-85084 Jul 25 08:57:17.321508 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-5af8c4c6-d5fe-4589-a12a-fb7a07972f7b req-5df19797-3802-4d76-8732-932bb0b5a3bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148580 Jul 25 08:57:17.325751 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 521/1073] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:57:17.356005 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:17.356981 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:17.365468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:17.366031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:17.367048 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:17.367701 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:17.460175 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:17.461364 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:17.462067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lazy-loading 'fault' on Instance uuid e48872a7-8219-4458-8832-bc33f66c0250 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:57:17.506057 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718ca333456f4de5b98f191ab40cca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9313fe06660f4049be47f901c3fc6f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:17.514853 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-12174676-8597-47ef-a8f3-a5f3efa88568 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 200 len: 1328 microversion: 2.1 time: 0.163830 Jul 25 08:57:17.515606 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 553/1074] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:17 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 1328 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:17.717048 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bc7668b6-102c-417e-83e0-308b753b53be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:17.717987 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bc7668b6-102c-417e-83e0-308b753b53be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:17.720688 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:17.733630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc7668b6-102c-417e-83e0-308b753b53be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:17.734402 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc7668b6-102c-417e-83e0-308b753b53be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:17.735845 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc7668b6-102c-417e-83e0-308b753b53be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:17.736435 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bc7668b6-102c-417e-83e0-308b753b53be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:17.943565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bc7668b6-102c-417e-83e0-308b753b53be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:17.953636 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bc7668b6-102c-417e-83e0-308b753b53be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:17.955674 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bc7668b6-102c-417e-83e0-308b753b53be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:17.957389 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bc7668b6-102c-417e-83e0-308b753b53be tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.252965 Jul 25 08:57:17.958365 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 522/1075] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:17 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:18.535929 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d2c30688-f47e-4aa6-b6a7-9419215c2dd5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:18.536626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d2c30688-f47e-4aa6-b6a7-9419215c2dd5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:18.543080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d2c30688-f47e-4aa6-b6a7-9419215c2dd5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:18.543696 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d2c30688-f47e-4aa6-b6a7-9419215c2dd5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:18.544609 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d2c30688-f47e-4aa6-b6a7-9419215c2dd5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:18.545041 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d2c30688-f47e-4aa6-b6a7-9419215c2dd5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:18.566876 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-d2c30688-f47e-4aa6-b6a7-9419215c2dd5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] HTTP exception thrown: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d2c30688-f47e-4aa6-b6a7-9419215c2dd5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Request method failure captured: Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 HTTP/1.1 Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhAad7eCfEu2Bu7qVsSTeoTEvi_lNRONzSSbzxsjeFcrmg9WeZQEqit9vbLBGyU0mS1VrJ5YXp_dKmheyat1SCH2bu5lSNt6It9v08o32oiqsolToR8oxlZ3XQjtpRgWkdNdXCaJqsj2oXu4k3s8kQ5tx6A_zn65KKK6GVWtuYvlSs Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:57:18.568773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9313fe06660f4049be47f901c3fc6f76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}] Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 718ca333456f4de5b98f191ab40cca0b Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:18.570604 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': 'e48872a7-8219-4458-8832-bc33f66c0250'} Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:57:18.571638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:18.573311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:18.574855 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d2c30688-f47e-4aa6-b6a7-9419215c2dd5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Returning 404 to user: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:57:18.574855 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d2c30688-f47e-4aa6-b6a7-9419215c2dd5 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 404 len: 111 microversion: 2.1 time: 0.040695 Jul 25 08:57:18.574855 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 554/1076] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:18 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:57:18.581951 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4de781d1-0f31-4eea-98aa-0980065f7be2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '.version_select at 0x7f0f79bf9040>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:18.605487 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4de781d1-0f31-4eea-98aa-0980065f7be2 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065406991" status: 202 len: 0 microversion: 2.1 time: 0.027300 Jul 25 08:57:18.606607 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 523/1077] 10.222.0.52 () {58 vars in 1221 bytes} [Mon Jul 25 08:57:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065406991 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:57:18.982877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-eed28e5a-9a5d-409c-a70a-c4a8b80f42e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:18.983629 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-eed28e5a-9a5d-409c-a70a-c4a8b80f42e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:18.990717 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eed28e5a-9a5d-409c-a70a-c4a8b80f42e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:18.991368 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eed28e5a-9a5d-409c-a70a-c4a8b80f42e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:18.992370 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eed28e5a-9a5d-409c-a70a-c4a8b80f42e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:18.992984 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eed28e5a-9a5d-409c-a70a-c4a8b80f42e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:19.214160 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-eed28e5a-9a5d-409c-a70a-c4a8b80f42e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:19.224171 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-eed28e5a-9a5d-409c-a70a-c4a8b80f42e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:19.228092 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-eed28e5a-9a5d-409c-a70a-c4a8b80f42e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:19.229780 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-eed28e5a-9a5d-409c-a70a-c4a8b80f42e5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.250892 Jul 25 08:57:19.230611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 555/1078] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:18 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:20.253952 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-13825b14-4fc9-4aaa-91d1-147fc9305d47 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:20.254663 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-13825b14-4fc9-4aaa-91d1-147fc9305d47 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:20.257033 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=4 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:20.264075 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-13825b14-4fc9-4aaa-91d1-147fc9305d47 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:20.264528 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-13825b14-4fc9-4aaa-91d1-147fc9305d47 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:20.265325 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-13825b14-4fc9-4aaa-91d1-147fc9305d47 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:20.265762 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-13825b14-4fc9-4aaa-91d1-147fc9305d47 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:20.407870 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-13825b14-4fc9-4aaa-91d1-147fc9305d47 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:20.416587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-13825b14-4fc9-4aaa-91d1-147fc9305d47 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:20.418109 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-13825b14-4fc9-4aaa-91d1-147fc9305d47 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:20.419286 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-13825b14-4fc9-4aaa-91d1-147fc9305d47 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.169532 Jul 25 08:57:20.419853 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 524/1079] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:20 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:57:21.442397 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7fdda88e-039d-4b88-8f4a-5344dc8cc23a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:21.443008 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7fdda88e-039d-4b88-8f4a-5344dc8cc23a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:21.449691 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7fdda88e-039d-4b88-8f4a-5344dc8cc23a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:21.450140 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7fdda88e-039d-4b88-8f4a-5344dc8cc23a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:21.450897 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7fdda88e-039d-4b88-8f4a-5344dc8cc23a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:21.451518 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7fdda88e-039d-4b88-8f4a-5344dc8cc23a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:21.596226 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7fdda88e-039d-4b88-8f4a-5344dc8cc23a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:21.604399 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7fdda88e-039d-4b88-8f4a-5344dc8cc23a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:21.605963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7fdda88e-039d-4b88-8f4a-5344dc8cc23a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:21.607123 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7fdda88e-039d-4b88-8f4a-5344dc8cc23a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.168691 Jul 25 08:57:21.613030 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 556/1080] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:21 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:21.744593 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-04be305d-fc95-4ad2-87cb-86f89a27e9bc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:21.745129 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-04be305d-fc95-4ad2-87cb-86f89a27e9bc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:21.752761 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-04be305d-fc95-4ad2-87cb-86f89a27e9bc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:21.753220 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-04be305d-fc95-4ad2-87cb-86f89a27e9bc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:21.753999 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-04be305d-fc95-4ad2-87cb-86f89a27e9bc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:21.754436 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-04be305d-fc95-4ad2-87cb-86f89a27e9bc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:21.771028 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-04be305d-fc95-4ad2-87cb-86f89a27e9bc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] HTTP exception thrown: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-04be305d-fc95-4ad2-87cb-86f89a27e9bc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Request method failure captured: Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: DELETE /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 HTTP/1.1 Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhAad7eCfEu2Bu7qVsSTeoTEvi_lNRONzSSbzxsjeFcrmg9WeZQEqit9vbLBGyU0mS1VrJ5YXp_dKmheyat1SCH2bu5lSNt6It9v08o32oiqsolToR8oxlZ3XQjtpRgWkdNdXCaJqsj2oXu4k3s8kQ5tx6A_zn65KKK6GVWtuYvlSs Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:57:21.773865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9313fe06660f4049be47f901c3fc6f76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}] Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 718ca333456f4de5b98f191ab40cca0b Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:21.775387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'e48872a7-8219-4458-8832-bc33f66c0250'} Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:57:21.776192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:21.777954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:57:21.779248 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-04be305d-fc95-4ad2-87cb-86f89a27e9bc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Returning 404 to user: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:57:21.779248 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-04be305d-fc95-4ad2-87cb-86f89a27e9bc tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 404 len: 111 microversion: 2.1 time: 0.036724 Jul 25 08:57:21.779248 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 525/1081] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:57:21 2022] DELETE /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:57:21.786144 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a0e587e0-cd38-4e91-a255-00207ff3c936 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:21.787078 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a0e587e0-cd38-4e91-a255-00207ff3c936 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: e48872a7-8219-4458-8832-bc33f66c0250] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:21.794251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e587e0-cd38-4e91-a255-00207ff3c936 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:21.794720 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e587e0-cd38-4e91-a255-00207ff3c936 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:21.795526 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e587e0-cd38-4e91-a255-00207ff3c936 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:21.795959 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e587e0-cd38-4e91-a255-00207ff3c936 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:21.811932 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-a0e587e0-cd38-4e91-a255-00207ff3c936 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] HTTP exception thrown: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a0e587e0-cd38-4e91-a255-00207ff3c936 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Request method failure captured: Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 HTTP/1.1 Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhAad7eCfEu2Bu7qVsSTeoTEvi_lNRONzSSbzxsjeFcrmg9WeZQEqit9vbLBGyU0mS1VrJ5YXp_dKmheyat1SCH2bu5lSNt6It9v08o32oiqsolToR8oxlZ3XQjtpRgWkdNdXCaJqsj2oXu4k3s8kQ5tx6A_zn65KKK6GVWtuYvlSs Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:57:21.816901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9313fe06660f4049be47f901c3fc6f76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}] Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 718ca333456f4de5b98f191ab40cca0b Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:21.818398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': 'e48872a7-8219-4458-8832-bc33f66c0250'} Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:57:21.819256 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. Jul 25 08:57:21.820660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:21.821800 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a0e587e0-cd38-4e91-a255-00207ff3c936 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Returning 404 to user: Instance e48872a7-8219-4458-8832-bc33f66c0250 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:57:21.821800 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a0e587e0-cd38-4e91-a255-00207ff3c936 tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250" status: 404 len: 111 microversion: 2.1 time: 0.036143 Jul 25 08:57:21.821800 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 557/1082] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:21 2022] GET /compute/v2.1/servers/e48872a7-8219-4458-8832-bc33f66c0250 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:57:22.631744 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a6d2db94-ee5e-4d87-9e20-e00e4c7e6670 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:22.632498 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a6d2db94-ee5e-4d87-9e20-e00e4c7e6670 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:22.647858 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a6d2db94-ee5e-4d87-9e20-e00e4c7e6670 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:22.648387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a6d2db94-ee5e-4d87-9e20-e00e4c7e6670 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:22.649250 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a6d2db94-ee5e-4d87-9e20-e00e4c7e6670 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:22.650175 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a6d2db94-ee5e-4d87-9e20-e00e4c7e6670 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:22.804249 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a6d2db94-ee5e-4d87-9e20-e00e4c7e6670 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:22.813659 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a6d2db94-ee5e-4d87-9e20-e00e4c7e6670 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:22.815211 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a6d2db94-ee5e-4d87-9e20-e00e4c7e6670 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:22.816368 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a6d2db94-ee5e-4d87-9e20-e00e4c7e6670 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.188618 Jul 25 08:57:22.816985 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 526/1083] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:22 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:22.974468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2f8bc520-1678-4e90-b6cc-5deebc338c6f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:22.974973 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2f8bc520-1678-4e90-b6cc-5deebc338c6f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:22.982381 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2f8bc520-1678-4e90-b6cc-5deebc338c6f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:22.982836 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2f8bc520-1678-4e90-b6cc-5deebc338c6f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:22.983613 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2f8bc520-1678-4e90-b6cc-5deebc338c6f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:22.984046 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2f8bc520-1678-4e90-b6cc-5deebc338c6f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:22.999285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-2f8bc520-1678-4e90-b6cc-5deebc338c6f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] HTTP exception thrown: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2f8bc520-1678-4e90-b6cc-5deebc338c6f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Request method failure captured: Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: DELETE /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 HTTP/1.1 Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhAad7eCfEu2Bu7qVsSTeoTEvi_lNRONzSSbzxsjeFcrmg9WeZQEqit9vbLBGyU0mS1VrJ5YXp_dKmheyat1SCH2bu5lSNt6It9v08o32oiqsolToR8oxlZ3XQjtpRgWkdNdXCaJqsj2oXu4k3s8kQ5tx6A_zn65KKK6GVWtuYvlSs Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:57:23.001075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9313fe06660f4049be47f901c3fc6f76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}] Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 718ca333456f4de5b98f191ab40cca0b Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:57:23.002744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': 'c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7'} Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:57:23.003617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:57:23.005125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:57:23.006622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2f8bc520-1678-4e90-b6cc-5deebc338c6f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Returning 404 to user: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:57:23.006622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2f8bc520-1678-4e90-b6cc-5deebc338c6f tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 404 len: 111 microversion: 2.1 time: 0.032416 Jul 25 08:57:23.006622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 558/1084] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:57:22 2022] DELETE /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:57:23.011031 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-93c6851b-b57b-44ed-861d-7624a095168e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:23.011954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-93c6851b-b57b-44ed-861d-7624a095168e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] [instance: c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:23.018624 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-93c6851b-b57b-44ed-861d-7624a095168e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:23.019655 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-93c6851b-b57b-44ed-861d-7624a095168e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:23.020450 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-93c6851b-b57b-44ed-861d-7624a095168e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:23.020919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-93c6851b-b57b-44ed-861d-7624a095168e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:23.035018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-93c6851b-b57b-44ed-861d-7624a095168e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] HTTP exception thrown: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-93c6851b-b57b-44ed-861d-7624a095168e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Request method failure captured: Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 HTTP/1.1 Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhAad7eCfEu2Bu7qVsSTeoTEvi_lNRONzSSbzxsjeFcrmg9WeZQEqit9vbLBGyU0mS1VrJ5YXp_dKmheyat1SCH2bu5lSNt6It9v08o32oiqsolToR8oxlZ3XQjtpRgWkdNdXCaJqsj2oXu4k3s8kQ5tx6A_zn65KKK6GVWtuYvlSs Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:57:23.036545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9313fe06660f4049be47f901c3fc6f76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9313fe06660f4049be47f901c3fc6f76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9313fe06660f4049be47f901c3fc6f76"}]}] Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 9313fe06660f4049be47f901c3fc6f76 Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937894486 Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 718ca333456f4de5b98f191ab40cca0b Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeTestJSON-937894486-project Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:57:23.038229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7'} Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:57:23.039367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. Jul 25 08:57:23.040847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:57:23.042515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-93c6851b-b57b-44ed-861d-7624a095168e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] Returning 404 to user: Instance c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:57:23.042515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-93c6851b-b57b-44ed-861d-7624a095168e tempest-AttachVolumeTestJSON-937894486 tempest-AttachVolumeTestJSON-937894486-project] 10.222.0.52 "GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7" status: 404 len: 111 microversion: 2.1 time: 0.030834 Jul 25 08:57:23.042515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 527/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:23 2022] GET /compute/v2.1/servers/c688bc6c-962d-4b9a-bcf4-8e3c4f17ced7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:57:23.839782 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2daf5f36-3a38-40d1-8ab2-995291c4a51a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:23.840430 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2daf5f36-3a38-40d1-8ab2-995291c4a51a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:23.847436 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2daf5f36-3a38-40d1-8ab2-995291c4a51a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:23.847888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2daf5f36-3a38-40d1-8ab2-995291c4a51a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:23.848898 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2daf5f36-3a38-40d1-8ab2-995291c4a51a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:23.849338 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2daf5f36-3a38-40d1-8ab2-995291c4a51a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:24.009897 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2daf5f36-3a38-40d1-8ab2-995291c4a51a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:24.027043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2daf5f36-3a38-40d1-8ab2-995291c4a51a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:24.029017 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2daf5f36-3a38-40d1-8ab2-995291c4a51a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:24.030465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2daf5f36-3a38-40d1-8ab2-995291c4a51a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.194592 Jul 25 08:57:24.031057 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 559/1086] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:23 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:25.054964 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2de1ac60-81ca-4aa1-ac37-8fd8de46d849 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:25.055820 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2de1ac60-81ca-4aa1-ac37-8fd8de46d849 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:25.068871 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2de1ac60-81ca-4aa1-ac37-8fd8de46d849 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:25.069360 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2de1ac60-81ca-4aa1-ac37-8fd8de46d849 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:25.070171 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2de1ac60-81ca-4aa1-ac37-8fd8de46d849 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:25.070607 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2de1ac60-81ca-4aa1-ac37-8fd8de46d849 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:25.318015 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2de1ac60-81ca-4aa1-ac37-8fd8de46d849 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:25.327280 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2de1ac60-81ca-4aa1-ac37-8fd8de46d849 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:25.329603 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2de1ac60-81ca-4aa1-ac37-8fd8de46d849 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:25.331785 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2de1ac60-81ca-4aa1-ac37-8fd8de46d849 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.280165 Jul 25 08:57:25.332773 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 528/1087] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:25 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:26.360125 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ef7d5fca-1dc2-482b-8238-e8d7f69a625a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:26.362885 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ef7d5fca-1dc2-482b-8238-e8d7f69a625a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:26.380620 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef7d5fca-1dc2-482b-8238-e8d7f69a625a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:26.381086 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef7d5fca-1dc2-482b-8238-e8d7f69a625a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:26.381880 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef7d5fca-1dc2-482b-8238-e8d7f69a625a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:26.382350 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef7d5fca-1dc2-482b-8238-e8d7f69a625a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:26.637428 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ef7d5fca-1dc2-482b-8238-e8d7f69a625a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:26.643901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:26.649848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ef7d5fca-1dc2-482b-8238-e8d7f69a625a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:26.651369 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ef7d5fca-1dc2-482b-8238-e8d7f69a625a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:26.654122 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ef7d5fca-1dc2-482b-8238-e8d7f69a625a tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.299585 Jul 25 08:57:26.670894 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 560/1088] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:26 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:57:27.678674 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3b434b9d-ef0f-4349-b367-7fd2a2110704 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:27.679373 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3b434b9d-ef0f-4349-b367-7fd2a2110704 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:27.691952 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3b434b9d-ef0f-4349-b367-7fd2a2110704 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:27.692773 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3b434b9d-ef0f-4349-b367-7fd2a2110704 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:27.694727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3b434b9d-ef0f-4349-b367-7fd2a2110704 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:27.694970 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3b434b9d-ef0f-4349-b367-7fd2a2110704 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:27.844487 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3b434b9d-ef0f-4349-b367-7fd2a2110704 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:27.853047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3b434b9d-ef0f-4349-b367-7fd2a2110704 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:27.854686 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3b434b9d-ef0f-4349-b367-7fd2a2110704 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:27.855962 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3b434b9d-ef0f-4349-b367-7fd2a2110704 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1740 microversion: 2.20 time: 0.181665 Jul 25 08:57:27.856664 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 529/1089] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:27 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:28.896864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bc0ddc48-08da-478a-a4b2-862daed82b20 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:28.897825 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bc0ddc48-08da-478a-a4b2-862daed82b20 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:28.908691 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bc0ddc48-08da-478a-a4b2-862daed82b20 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:28.909154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bc0ddc48-08da-478a-a4b2-862daed82b20 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:28.909954 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bc0ddc48-08da-478a-a4b2-862daed82b20 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:28.910399 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bc0ddc48-08da-478a-a4b2-862daed82b20 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:29.066963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bc0ddc48-08da-478a-a4b2-862daed82b20 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:29.076916 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bc0ddc48-08da-478a-a4b2-862daed82b20 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:29.079066 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bc0ddc48-08da-478a-a4b2-862daed82b20 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:29.080246 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bc0ddc48-08da-478a-a4b2-862daed82b20 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1722 microversion: 2.20 time: 0.190902 Jul 25 08:57:29.081075 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 561/1090] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:28 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:30.103371 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-283f465c-1c62-4080-8159-915e4861d663 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:30.104003 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-283f465c-1c62-4080-8159-915e4861d663 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:30.111095 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-283f465c-1c62-4080-8159-915e4861d663 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:30.111544 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-283f465c-1c62-4080-8159-915e4861d663 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:30.112307 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-283f465c-1c62-4080-8159-915e4861d663 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:30.112770 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-283f465c-1c62-4080-8159-915e4861d663 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:30.247338 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-283f465c-1c62-4080-8159-915e4861d663 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:30.256685 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-283f465c-1c62-4080-8159-915e4861d663 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:30.258246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-283f465c-1c62-4080-8159-915e4861d663 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:30.259460 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-283f465c-1c62-4080-8159-915e4861d663 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1722 microversion: 2.20 time: 0.160060 Jul 25 08:57:30.260012 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 530/1091] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:30 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:31.181735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-67866ed6-ac15-4709-8e55-0c268e44f5ae req-33013398-abb6-4761-a77c-6ac76cd42eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f22e6c-5c89-42ee-90ce-a87e77bfa17b", "name": "network-vif-unplugged", "status": "completed", "tag": "68b8d737-1cd3-4135-ad4b-35b7ce49fc3d"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:57:31.193963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-67866ed6-ac15-4709-8e55-0c268e44f5ae req-33013398-abb6-4761-a77c-6ac76cd42eff service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:31.195048 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-67866ed6-ac15-4709-8e55-0c268e44f5ae req-33013398-abb6-4761-a77c-6ac76cd42eff service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:31.209891 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-67866ed6-ac15-4709-8e55-0c268e44f5ae req-33013398-abb6-4761-a77c-6ac76cd42eff service nova] Creating event network-vif-unplugged:68b8d737-1cd3-4135-ad4b-35b7ce49fc3d for instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b on hv-cinder-85084 Jul 25 08:57:31.215861 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-67866ed6-ac15-4709-8e55-0c268e44f5ae req-33013398-abb6-4761-a77c-6ac76cd42eff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037873 Jul 25 08:57:31.216986 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 562/1092] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:57:31.282466 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ef79d80c-8182-40e3-8906-298c9af5d0c9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:31.283071 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ef79d80c-8182-40e3-8906-298c9af5d0c9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:31.290148 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ef79d80c-8182-40e3-8906-298c9af5d0c9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:31.290596 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ef79d80c-8182-40e3-8906-298c9af5d0c9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:31.291370 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ef79d80c-8182-40e3-8906-298c9af5d0c9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:31.291800 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ef79d80c-8182-40e3-8906-298c9af5d0c9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:31.430580 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ef79d80c-8182-40e3-8906-298c9af5d0c9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:31.439286 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ef79d80c-8182-40e3-8906-298c9af5d0c9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:31.440841 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ef79d80c-8182-40e3-8906-298c9af5d0c9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:31.442015 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ef79d80c-8182-40e3-8906-298c9af5d0c9 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1722 microversion: 2.20 time: 0.163477 Jul 25 08:57:31.442585 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 531/1093] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:31 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:32.471344 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9781feed-2807-4ce9-ab91-e7d356b8f4c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:32.472054 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9781feed-2807-4ce9-ab91-e7d356b8f4c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:32.479297 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9781feed-2807-4ce9-ab91-e7d356b8f4c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:32.479808 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9781feed-2807-4ce9-ab91-e7d356b8f4c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:32.480624 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9781feed-2807-4ce9-ab91-e7d356b8f4c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:32.481066 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9781feed-2807-4ce9-ab91-e7d356b8f4c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:32.632968 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9781feed-2807-4ce9-ab91-e7d356b8f4c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:32.641554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9781feed-2807-4ce9-ab91-e7d356b8f4c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:32.643059 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9781feed-2807-4ce9-ab91-e7d356b8f4c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:32.644210 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9781feed-2807-4ce9-ab91-e7d356b8f4c0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1665 microversion: 2.20 time: 0.177888 Jul 25 08:57:32.644794 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 563/1094] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:32 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:32.668167 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ba1f25c9-7f3c-4ac4-99e2-845d58760af0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbcf5510-8b64-419b-851e-b6f375ccfe10"}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:57:32.670530 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ba1f25c9-7f3c-4ac4-99e2-845d58760af0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:32.676723 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ba1f25c9-7f3c-4ac4-99e2-845d58760af0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:32.677174 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ba1f25c9-7f3c-4ac4-99e2-845d58760af0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:32.677940 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ba1f25c9-7f3c-4ac4-99e2-845d58760af0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:32.678377 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ba1f25c9-7f3c-4ac4-99e2-845d58760af0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:32.970073 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ba1f25c9-7f3c-4ac4-99e2-845d58760af0 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "POST /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306394 Jul 25 08:57:32.975996 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 532/1095] 10.222.0.52 () {62 vars in 1364 bytes} [Mon Jul 25 08:57:32 2022] POST /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 08:57:33.101662 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-583fc579-68fc-4fdb-b8b8-0424711dfb61 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:33.102157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-583fc579-68fc-4fdb-b8b8-0424711dfb61 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:33.108609 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-583fc579-68fc-4fdb-b8b8-0424711dfb61 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:33.109803 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-583fc579-68fc-4fdb-b8b8-0424711dfb61 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:33.110418 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-583fc579-68fc-4fdb-b8b8-0424711dfb61 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:33.110860 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-583fc579-68fc-4fdb-b8b8-0424711dfb61 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:33.366160 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-583fc579-68fc-4fdb-b8b8-0424711dfb61 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/os-volume_attachments/dbcf5510-8b64-419b-851e-b6f375ccfe10" status: 202 len: 0 microversion: 2.20 time: 0.269299 Jul 25 08:57:33.366838 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 564/1096] 10.222.0.52 () {60 vars in 1457 bytes} [Mon Jul 25 08:57:33 2022] DELETE /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/os-volume_attachments/dbcf5510-8b64-419b-851e-b6f375ccfe10 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:57:33.428507 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-82bc6eed-8c52-4b32-96ee-f011f1b733ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:57:33.435587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-82bc6eed-8c52-4b32-96ee-f011f1b733ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:33.443067 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-82bc6eed-8c52-4b32-96ee-f011f1b733ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:33.443520 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-82bc6eed-8c52-4b32-96ee-f011f1b733ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:33.444298 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-82bc6eed-8c52-4b32-96ee-f011f1b733ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:33.444768 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-82bc6eed-8c52-4b32-96ee-f011f1b733ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:33.448441 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:33.519915 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82bc6eed-8c52-4b32-96ee-f011f1b733ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [50af0011-d906-4e13-b1c4-aa955364effa] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 08:57:34.527967 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO oslo.messaging._drivers.impl_rabbit [None req-82bc6eed-8c52-4b32-96ee-f011f1b733ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [50af0011-d906-4e13-b1c4-aa955364effa] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 54972. Jul 25 08:57:34.531491 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-82bc6eed-8c52-4b32-96ee-f011f1b733ae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "POST /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/action" status: 202 len: 0 microversion: 2.20 time: 1.107066 Jul 25 08:57:34.532113 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 533/1097] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Jul 25 08:57:33 2022] POST /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/action => generated 0 bytes in 1108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:57:34.540225 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d6c48ad7-f31f-49a2-9216-2c37f56aaba2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:34.540875 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d6c48ad7-f31f-49a2-9216-2c37f56aaba2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:34.550306 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d6c48ad7-f31f-49a2-9216-2c37f56aaba2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:34.550775 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d6c48ad7-f31f-49a2-9216-2c37f56aaba2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:34.551549 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d6c48ad7-f31f-49a2-9216-2c37f56aaba2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:34.551989 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d6c48ad7-f31f-49a2-9216-2c37f56aaba2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:34.702311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d6c48ad7-f31f-49a2-9216-2c37f56aaba2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:34.711023 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d6c48ad7-f31f-49a2-9216-2c37f56aaba2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:34.712544 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d6c48ad7-f31f-49a2-9216-2c37f56aaba2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:34.713915 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d6c48ad7-f31f-49a2-9216-2c37f56aaba2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1673 microversion: 2.20 time: 0.177625 Jul 25 08:57:34.714459 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 565/1098] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:34 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:57:35.737710 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0c65ea17-e41b-4b32-b7cf-d7fdbbe18597 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:35.738318 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0c65ea17-e41b-4b32-b7cf-d7fdbbe18597 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:35.748359 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0c65ea17-e41b-4b32-b7cf-d7fdbbe18597 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:35.748728 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0c65ea17-e41b-4b32-b7cf-d7fdbbe18597 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:35.749516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0c65ea17-e41b-4b32-b7cf-d7fdbbe18597 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:35.750444 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0c65ea17-e41b-4b32-b7cf-d7fdbbe18597 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:35.879088 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0c65ea17-e41b-4b32-b7cf-d7fdbbe18597 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:35.887136 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0c65ea17-e41b-4b32-b7cf-d7fdbbe18597 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:35.888695 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0c65ea17-e41b-4b32-b7cf-d7fdbbe18597 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:35.889863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0c65ea17-e41b-4b32-b7cf-d7fdbbe18597 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1673 microversion: 2.20 time: 0.156618 Jul 25 08:57:35.891065 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 534/1099] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:35 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:36.913352 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-07914b80-96f9-435e-9fb1-c5a76d980b3e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:36.913953 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-07914b80-96f9-435e-9fb1-c5a76d980b3e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:36.920593 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07914b80-96f9-435e-9fb1-c5a76d980b3e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:36.921043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07914b80-96f9-435e-9fb1-c5a76d980b3e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:36.921853 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07914b80-96f9-435e-9fb1-c5a76d980b3e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:36.922283 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07914b80-96f9-435e-9fb1-c5a76d980b3e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:37.053663 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-07914b80-96f9-435e-9fb1-c5a76d980b3e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:37.061831 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-07914b80-96f9-435e-9fb1-c5a76d980b3e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:37.063260 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-07914b80-96f9-435e-9fb1-c5a76d980b3e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:37.064421 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-07914b80-96f9-435e-9fb1-c5a76d980b3e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1673 microversion: 2.20 time: 0.154956 Jul 25 08:57:37.065006 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 566/1100] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:36 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:38.087347 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a356d0e9-0f96-4db9-887c-4701a7c7db71 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:38.087878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a356d0e9-0f96-4db9-887c-4701a7c7db71 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:38.095370 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a356d0e9-0f96-4db9-887c-4701a7c7db71 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:38.095819 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a356d0e9-0f96-4db9-887c-4701a7c7db71 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:38.096616 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a356d0e9-0f96-4db9-887c-4701a7c7db71 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:38.097055 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a356d0e9-0f96-4db9-887c-4701a7c7db71 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:38.232335 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a356d0e9-0f96-4db9-887c-4701a7c7db71 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:38.241359 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a356d0e9-0f96-4db9-887c-4701a7c7db71 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:38.242857 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a356d0e9-0f96-4db9-887c-4701a7c7db71 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:38.244022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a356d0e9-0f96-4db9-887c-4701a7c7db71 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1673 microversion: 2.20 time: 0.160641 Jul 25 08:57:38.244888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 535/1101] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:38 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:39.268184 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-20375282-6360-401c-86be-2687b79c7d90 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:39.268902 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-20375282-6360-401c-86be-2687b79c7d90 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:39.276302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20375282-6360-401c-86be-2687b79c7d90 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:39.276789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20375282-6360-401c-86be-2687b79c7d90 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:39.277555 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20375282-6360-401c-86be-2687b79c7d90 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:39.277987 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20375282-6360-401c-86be-2687b79c7d90 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:39.424240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-20375282-6360-401c-86be-2687b79c7d90 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:39.432471 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-20375282-6360-401c-86be-2687b79c7d90 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:39.434212 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-20375282-6360-401c-86be-2687b79c7d90 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:39.435315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-20375282-6360-401c-86be-2687b79c7d90 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1673 microversion: 2.20 time: 0.171815 Jul 25 08:57:39.435873 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 567/1102] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:39 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:40.460595 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b11146d3-47c2-4c22-bba9-d5f260f5103f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:40.461207 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b11146d3-47c2-4c22-bba9-d5f260f5103f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:40.467931 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b11146d3-47c2-4c22-bba9-d5f260f5103f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:40.468374 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b11146d3-47c2-4c22-bba9-d5f260f5103f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:40.469682 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b11146d3-47c2-4c22-bba9-d5f260f5103f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:40.470114 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b11146d3-47c2-4c22-bba9-d5f260f5103f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:40.623009 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b11146d3-47c2-4c22-bba9-d5f260f5103f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:40.637272 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b11146d3-47c2-4c22-bba9-d5f260f5103f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:40.640164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b11146d3-47c2-4c22-bba9-d5f260f5103f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:40.642051 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b11146d3-47c2-4c22-bba9-d5f260f5103f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.185325 Jul 25 08:57:40.642635 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 536/1103] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:40 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:41.200109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1667258943", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1342922356", "security_groups": [{"name": "tempest-secgroup-smoke-2078811933"}], "block_device_mapping_v2": [{"uuid": "7d1c8f04-0ce4-4f32-8541-64b404b2884a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1708f1a6-6a61-4ee3-995b-a3b155211357"}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:57:41.329366 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] validate_networks() for [('1708f1a6-6a61-4ee3-995b-a3b155211357', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:57:41.666206 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3868612f-7ba4-4ce2-a379-ebe9df7609f3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:41.667573 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3868612f-7ba4-4ce2-a379-ebe9df7609f3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:41.674054 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3868612f-7ba4-4ce2-a379-ebe9df7609f3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:41.674689 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3868612f-7ba4-4ce2-a379-ebe9df7609f3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:41.675476 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3868612f-7ba4-4ce2-a379-ebe9df7609f3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:41.676008 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3868612f-7ba4-4ce2-a379-ebe9df7609f3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:41.934709 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:57:41.935965 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:57:41.936277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:57:41.937012 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:57:41.937997 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:57:41.949431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:41.950209 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:41.951316 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:41.951967 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:41.970550 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3868612f-7ba4-4ce2-a379-ebe9df7609f3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:41.980112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3868612f-7ba4-4ce2-a379-ebe9df7609f3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:41.983462 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3868612f-7ba4-4ce2-a379-ebe9df7609f3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:41.985637 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3868612f-7ba4-4ce2-a379-ebe9df7609f3 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.323350 Jul 25 08:57:41.986574 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 537/1104] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:41 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:57:41.995343 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Getting quotas for project 5005a107ff1940908069356c788185f6. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:57:42.002262 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Getting quotas for user a1a3d224feb94a1baa75a03bc8d1132a and project 5005a107ff1940908069356c788185f6. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:57:42.121957 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:57:42.124461 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d1c8f04-0ce4-4f32-8541-64b404b2884a',volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:57:42.376669 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-47f4764a-ff77-47ca-a973-b2c877126764 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.180472 Jul 25 08:57:42.384610 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 568/1105] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:57:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 08:57:42.391592 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1898dbac-379b-4042-8b74-18ee09a55733 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:42.392621 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1898dbac-379b-4042-8b74-18ee09a55733 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:42.495090 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1898dbac-379b-4042-8b74-18ee09a55733 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:42.504208 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1898dbac-379b-4042-8b74-18ee09a55733 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1095 microversion: 2.1 time: 0.119399 Jul 25 08:57:42.504842 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 538/1106] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:42 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1095 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:43.019216 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-938dd85f-d0f5-442d-a191-570bc2c55ac5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:43.024978 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-938dd85f-d0f5-442d-a191-570bc2c55ac5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:43.049778 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-938dd85f-d0f5-442d-a191-570bc2c55ac5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:43.050745 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-938dd85f-d0f5-442d-a191-570bc2c55ac5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:43.052217 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-938dd85f-d0f5-442d-a191-570bc2c55ac5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:43.053219 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-938dd85f-d0f5-442d-a191-570bc2c55ac5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:43.293884 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-938dd85f-d0f5-442d-a191-570bc2c55ac5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:43.305148 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-938dd85f-d0f5-442d-a191-570bc2c55ac5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:43.307186 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-938dd85f-d0f5-442d-a191-570bc2c55ac5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:43.308614 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-938dd85f-d0f5-442d-a191-570bc2c55ac5 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.300475 Jul 25 08:57:43.324879 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 569/1107] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:43 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:43.528991 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d6bdd5c3-c998-4f83-9050-587b594bbea4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:43.530096 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d6bdd5c3-c998-4f83-9050-587b594bbea4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:43.542922 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6bdd5c3-c998-4f83-9050-587b594bbea4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:43.547684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6bdd5c3-c998-4f83-9050-587b594bbea4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:43.548676 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6bdd5c3-c998-4f83-9050-587b594bbea4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:43.550377 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d6bdd5c3-c998-4f83-9050-587b594bbea4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:43.654129 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d6bdd5c3-c998-4f83-9050-587b594bbea4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:43.663521 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d6bdd5c3-c998-4f83-9050-587b594bbea4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.140857 Jul 25 08:57:43.664119 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 539/1108] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:43 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:44.349901 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4770e442-c18b-4761-8036-335a1d048bef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:44.354448 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4770e442-c18b-4761-8036-335a1d048bef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:44.375705 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4770e442-c18b-4761-8036-335a1d048bef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:44.376459 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4770e442-c18b-4761-8036-335a1d048bef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:44.377935 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4770e442-c18b-4761-8036-335a1d048bef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:44.378673 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4770e442-c18b-4761-8036-335a1d048bef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:44.596665 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4770e442-c18b-4761-8036-335a1d048bef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:44.606725 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4770e442-c18b-4761-8036-335a1d048bef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:44.608463 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4770e442-c18b-4761-8036-335a1d048bef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:44.610944 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4770e442-c18b-4761-8036-335a1d048bef tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.279854 Jul 25 08:57:44.611527 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 570/1109] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:44 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 08:57:44.683472 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-591ba605-6eb2-47d9-bb3b-f4de62e9e0d1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:44.684089 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-591ba605-6eb2-47d9-bb3b-f4de62e9e0d1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:44.693474 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-591ba605-6eb2-47d9-bb3b-f4de62e9e0d1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:44.694397 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-591ba605-6eb2-47d9-bb3b-f4de62e9e0d1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:44.695609 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-591ba605-6eb2-47d9-bb3b-f4de62e9e0d1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:44.696281 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-591ba605-6eb2-47d9-bb3b-f4de62e9e0d1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:44.791060 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-591ba605-6eb2-47d9-bb3b-f4de62e9e0d1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:44.805584 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-591ba605-6eb2-47d9-bb3b-f4de62e9e0d1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.125819 Jul 25 08:57:44.806523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 540/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:44 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:45.635691 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dd6447b2-073f-420f-8d0d-d29aa11f6ab6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:45.636606 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dd6447b2-073f-420f-8d0d-d29aa11f6ab6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:45.644184 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dd6447b2-073f-420f-8d0d-d29aa11f6ab6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:45.644751 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dd6447b2-073f-420f-8d0d-d29aa11f6ab6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:45.646136 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dd6447b2-073f-420f-8d0d-d29aa11f6ab6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:45.646136 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dd6447b2-073f-420f-8d0d-d29aa11f6ab6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:45.841269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-dbf39908-8506-4180-a3a5-13c1eda7aa18 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:45.841786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dd6447b2-073f-420f-8d0d-d29aa11f6ab6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:45.842834 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-dbf39908-8506-4180-a3a5-13c1eda7aa18 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:45.856226 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dd6447b2-073f-420f-8d0d-d29aa11f6ab6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:45.858414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dd6447b2-073f-420f-8d0d-d29aa11f6ab6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:45.860053 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dd6447b2-073f-420f-8d0d-d29aa11f6ab6 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.228499 Jul 25 08:57:45.861263 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 571/1111] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:45 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:45.864266 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dbf39908-8506-4180-a3a5-13c1eda7aa18 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:45.868314 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dbf39908-8506-4180-a3a5-13c1eda7aa18 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:45.869847 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dbf39908-8506-4180-a3a5-13c1eda7aa18 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:45.870507 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-dbf39908-8506-4180-a3a5-13c1eda7aa18 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:45.956100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-dbf39908-8506-4180-a3a5-13c1eda7aa18 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:45.965301 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-dbf39908-8506-4180-a3a5-13c1eda7aa18 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.128370 Jul 25 08:57:45.966090 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 541/1112] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:45 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:46.892565 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-be25b671-396e-4641-b752-038d9565818d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:46.894227 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-be25b671-396e-4641-b752-038d9565818d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:46.897196 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:46.905036 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be25b671-396e-4641-b752-038d9565818d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:46.905850 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be25b671-396e-4641-b752-038d9565818d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:46.907194 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be25b671-396e-4641-b752-038d9565818d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:46.908034 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be25b671-396e-4641-b752-038d9565818d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:46.989084 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4673972c-b327-49ef-9a5c-93b22a0eea9b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:46.992737 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4673972c-b327-49ef-9a5c-93b22a0eea9b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:46.999951 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4673972c-b327-49ef-9a5c-93b22a0eea9b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:47.000403 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4673972c-b327-49ef-9a5c-93b22a0eea9b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:47.001211 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4673972c-b327-49ef-9a5c-93b22a0eea9b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:47.008190 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4673972c-b327-49ef-9a5c-93b22a0eea9b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:47.127619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4673972c-b327-49ef-9a5c-93b22a0eea9b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:47.138147 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4673972c-b327-49ef-9a5c-93b22a0eea9b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.154466 Jul 25 08:57:47.138970 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 542/1113] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:46 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:57:47.151127 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-be25b671-396e-4641-b752-038d9565818d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:47.161987 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-be25b671-396e-4641-b752-038d9565818d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:47.163541 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-be25b671-396e-4641-b752-038d9565818d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:47.164783 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-be25b671-396e-4641-b752-038d9565818d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.276712 Jul 25 08:57:47.165371 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 572/1114] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:46 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:48.160987 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a2c84acd-e34d-4e91-9dd0-15104c59f144 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:48.161857 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a2c84acd-e34d-4e91-9dd0-15104c59f144 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:48.164440 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:48.176938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a2c84acd-e34d-4e91-9dd0-15104c59f144 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:48.182264 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a2c84acd-e34d-4e91-9dd0-15104c59f144 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:48.185117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a2c84acd-e34d-4e91-9dd0-15104c59f144 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:48.186394 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a2c84acd-e34d-4e91-9dd0-15104c59f144 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:48.190251 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7102c869-8585-4340-9ee0-fd04a7552e13 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:48.191027 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7102c869-8585-4340-9ee0-fd04a7552e13 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:48.210587 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7102c869-8585-4340-9ee0-fd04a7552e13 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:48.210587 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7102c869-8585-4340-9ee0-fd04a7552e13 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:48.210587 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7102c869-8585-4340-9ee0-fd04a7552e13 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:48.215488 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7102c869-8585-4340-9ee0-fd04a7552e13 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:48.348818 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a2c84acd-e34d-4e91-9dd0-15104c59f144 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:48.357495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a2c84acd-e34d-4e91-9dd0-15104c59f144 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.201078 Jul 25 08:57:48.370632 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 543/1115] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:48 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:48.484887 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7102c869-8585-4340-9ee0-fd04a7552e13 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:48.496386 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7102c869-8585-4340-9ee0-fd04a7552e13 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:48.498514 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7102c869-8585-4340-9ee0-fd04a7552e13 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:48.500096 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7102c869-8585-4340-9ee0-fd04a7552e13 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.314107 Jul 25 08:57:48.501272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 573/1116] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:48 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:49.378343 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a01fd4ee-80e1-4dbb-a3f6-39e4cd56a3f0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:49.379043 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a01fd4ee-80e1-4dbb-a3f6-39e4cd56a3f0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:49.388251 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a01fd4ee-80e1-4dbb-a3f6-39e4cd56a3f0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:49.388745 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a01fd4ee-80e1-4dbb-a3f6-39e4cd56a3f0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:49.389532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a01fd4ee-80e1-4dbb-a3f6-39e4cd56a3f0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:49.393179 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a01fd4ee-80e1-4dbb-a3f6-39e4cd56a3f0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:49.490294 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a01fd4ee-80e1-4dbb-a3f6-39e4cd56a3f0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:49.505500 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a01fd4ee-80e1-4dbb-a3f6-39e4cd56a3f0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.130049 Jul 25 08:57:49.506871 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 544/1117] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:49 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:49.524847 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c6c97853-d1cd-4738-8e2f-c1ebfd9c2d24 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:49.525480 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c6c97853-d1cd-4738-8e2f-c1ebfd9c2d24 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:49.532391 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c6c97853-d1cd-4738-8e2f-c1ebfd9c2d24 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:49.532871 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c6c97853-d1cd-4738-8e2f-c1ebfd9c2d24 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:49.533661 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c6c97853-d1cd-4738-8e2f-c1ebfd9c2d24 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:49.534095 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c6c97853-d1cd-4738-8e2f-c1ebfd9c2d24 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:49.723681 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c6c97853-d1cd-4738-8e2f-c1ebfd9c2d24 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:49.729631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c6c97853-d1cd-4738-8e2f-c1ebfd9c2d24 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:49.731170 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c6c97853-d1cd-4738-8e2f-c1ebfd9c2d24 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:49.732428 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c6c97853-d1cd-4738-8e2f-c1ebfd9c2d24 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.212938 Jul 25 08:57:49.732962 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 574/1118] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:49 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:50.534314 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0afb4d0c-0cab-48be-adf2-b6cfccc32a1c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:50.535153 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0afb4d0c-0cab-48be-adf2-b6cfccc32a1c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:50.543081 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0afb4d0c-0cab-48be-adf2-b6cfccc32a1c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:50.543639 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0afb4d0c-0cab-48be-adf2-b6cfccc32a1c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:50.544420 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0afb4d0c-0cab-48be-adf2-b6cfccc32a1c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:50.545084 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0afb4d0c-0cab-48be-adf2-b6cfccc32a1c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:50.612164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-0afb4d0c-0cab-48be-adf2-b6cfccc32a1c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:50.620012 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0afb4d0c-0cab-48be-adf2-b6cfccc32a1c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.090946 Jul 25 08:57:50.620598 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 545/1119] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:50 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:50.757722 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e64e45e7-c5cb-4cfc-89d5-8912451c8d60 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:50.758356 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e64e45e7-c5cb-4cfc-89d5-8912451c8d60 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:50.767775 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e64e45e7-c5cb-4cfc-89d5-8912451c8d60 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:50.768452 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e64e45e7-c5cb-4cfc-89d5-8912451c8d60 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:50.769276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e64e45e7-c5cb-4cfc-89d5-8912451c8d60 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:50.769701 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e64e45e7-c5cb-4cfc-89d5-8912451c8d60 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:50.920761 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e64e45e7-c5cb-4cfc-89d5-8912451c8d60 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:50.930295 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e64e45e7-c5cb-4cfc-89d5-8912451c8d60 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:50.941935 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e64e45e7-c5cb-4cfc-89d5-8912451c8d60 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:50.943638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e64e45e7-c5cb-4cfc-89d5-8912451c8d60 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.191172 Jul 25 08:57:50.944635 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 575/1120] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:50 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:51.641805 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-34043478-8537-46c3-b760-d750093714bc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:51.642428 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-34043478-8537-46c3-b760-d750093714bc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:51.649231 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-34043478-8537-46c3-b760-d750093714bc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:51.649673 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-34043478-8537-46c3-b760-d750093714bc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:51.650447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-34043478-8537-46c3-b760-d750093714bc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:51.650882 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-34043478-8537-46c3-b760-d750093714bc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:51.759399 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-34043478-8537-46c3-b760-d750093714bc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:51.767348 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-34043478-8537-46c3-b760-d750093714bc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.129959 Jul 25 08:57:51.768226 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 546/1121] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:51 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:51.970310 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-006765a2-b374-4614-997a-a0c0e209f70d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:51.971219 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-006765a2-b374-4614-997a-a0c0e209f70d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:51.977946 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:51.979682 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-006765a2-b374-4614-997a-a0c0e209f70d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:51.980192 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-006765a2-b374-4614-997a-a0c0e209f70d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:51.980986 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-006765a2-b374-4614-997a-a0c0e209f70d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:51.981423 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-006765a2-b374-4614-997a-a0c0e209f70d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:52.000357 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:52.022276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:52.142278 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-006765a2-b374-4614-997a-a0c0e209f70d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:52.158280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-006765a2-b374-4614-997a-a0c0e209f70d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:52.160129 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-006765a2-b374-4614-997a-a0c0e209f70d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:52.161617 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-006765a2-b374-4614-997a-a0c0e209f70d tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.198241 Jul 25 08:57:52.162172 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 576/1122] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:51 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:52.789380 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-9be5385d-690c-4490-af5d-151e5593197f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:52.789988 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-9be5385d-690c-4490-af5d-151e5593197f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:52.791833 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:52.799230 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9be5385d-690c-4490-af5d-151e5593197f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:52.799492 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9be5385d-690c-4490-af5d-151e5593197f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:52.800211 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9be5385d-690c-4490-af5d-151e5593197f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:52.800674 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-9be5385d-690c-4490-af5d-151e5593197f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:52.863757 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-9be5385d-690c-4490-af5d-151e5593197f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:52.871615 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-9be5385d-690c-4490-af5d-151e5593197f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.086079 Jul 25 08:57:52.872629 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 547/1123] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:52 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:53.191933 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6ce1dfbe-1cb3-426e-aa29-2e8d65a8f89e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:53.192524 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6ce1dfbe-1cb3-426e-aa29-2e8d65a8f89e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:53.199897 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ce1dfbe-1cb3-426e-aa29-2e8d65a8f89e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:53.200376 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ce1dfbe-1cb3-426e-aa29-2e8d65a8f89e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:53.201241 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ce1dfbe-1cb3-426e-aa29-2e8d65a8f89e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:53.201731 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ce1dfbe-1cb3-426e-aa29-2e8d65a8f89e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:53.353954 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6ce1dfbe-1cb3-426e-aa29-2e8d65a8f89e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:53.363261 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6ce1dfbe-1cb3-426e-aa29-2e8d65a8f89e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:53.364794 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6ce1dfbe-1cb3-426e-aa29-2e8d65a8f89e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:53.365960 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6ce1dfbe-1cb3-426e-aa29-2e8d65a8f89e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.178575 Jul 25 08:57:53.366527 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 577/1124] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:53 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:53.892645 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ca562f49-1dbb-4b61-b6c9-74d663ea9159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:53.893388 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ca562f49-1dbb-4b61-b6c9-74d663ea9159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:53.900158 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca562f49-1dbb-4b61-b6c9-74d663ea9159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:53.900637 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca562f49-1dbb-4b61-b6c9-74d663ea9159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:53.901410 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca562f49-1dbb-4b61-b6c9-74d663ea9159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:53.901851 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca562f49-1dbb-4b61-b6c9-74d663ea9159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:53.961592 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ca562f49-1dbb-4b61-b6c9-74d663ea9159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:53.968987 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ca562f49-1dbb-4b61-b6c9-74d663ea9159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.080795 Jul 25 08:57:53.969546 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 548/1125] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:53 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:54.389438 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-41e2bb3b-e992-4335-b106-bbe09a40eb33 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:54.390052 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-41e2bb3b-e992-4335-b106-bbe09a40eb33 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:54.396707 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-41e2bb3b-e992-4335-b106-bbe09a40eb33 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:54.397157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-41e2bb3b-e992-4335-b106-bbe09a40eb33 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:54.397924 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-41e2bb3b-e992-4335-b106-bbe09a40eb33 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:54.398359 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-41e2bb3b-e992-4335-b106-bbe09a40eb33 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:54.530695 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-41e2bb3b-e992-4335-b106-bbe09a40eb33 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:54.539240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-41e2bb3b-e992-4335-b106-bbe09a40eb33 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:54.540790 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-41e2bb3b-e992-4335-b106-bbe09a40eb33 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:54.541941 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-41e2bb3b-e992-4335-b106-bbe09a40eb33 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.156528 Jul 25 08:57:54.542495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 578/1126] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:54 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:54.988918 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b743b9e3-7c73-486e-b8e6-b3655c03c357 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:54.989528 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b743b9e3-7c73-486e-b8e6-b3655c03c357 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:54.996268 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b743b9e3-7c73-486e-b8e6-b3655c03c357 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:54.996790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b743b9e3-7c73-486e-b8e6-b3655c03c357 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:54.997523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b743b9e3-7c73-486e-b8e6-b3655c03c357 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:54.997957 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b743b9e3-7c73-486e-b8e6-b3655c03c357 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:55.068405 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b743b9e3-7c73-486e-b8e6-b3655c03c357 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:55.072100 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:55.077400 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b743b9e3-7c73-486e-b8e6-b3655c03c357 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.092370 Jul 25 08:57:55.078841 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 549/1127] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:54 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:55.566377 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e3858356-540e-412b-a099-9acfa797e676 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:55.567099 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e3858356-540e-412b-a099-9acfa797e676 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:55.573453 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e3858356-540e-412b-a099-9acfa797e676 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:55.573881 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e3858356-540e-412b-a099-9acfa797e676 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:55.574640 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e3858356-540e-412b-a099-9acfa797e676 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:55.575070 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e3858356-540e-412b-a099-9acfa797e676 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:55.708794 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e3858356-540e-412b-a099-9acfa797e676 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:55.717178 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e3858356-540e-412b-a099-9acfa797e676 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:55.718690 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e3858356-540e-412b-a099-9acfa797e676 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:55.720074 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e3858356-540e-412b-a099-9acfa797e676 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.158229 Jul 25 08:57:55.720663 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 579/1128] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:55 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:56.100090 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-edc85cdb-c3b0-4688-8b97-f283237104bd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:56.100747 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-edc85cdb-c3b0-4688-8b97-f283237104bd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:56.110672 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-edc85cdb-c3b0-4688-8b97-f283237104bd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:56.111108 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-edc85cdb-c3b0-4688-8b97-f283237104bd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:56.111977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-edc85cdb-c3b0-4688-8b97-f283237104bd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:56.112312 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-edc85cdb-c3b0-4688-8b97-f283237104bd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:56.186515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-edc85cdb-c3b0-4688-8b97-f283237104bd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:56.197032 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-edc85cdb-c3b0-4688-8b97-f283237104bd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.101253 Jul 25 08:57:56.197662 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 550/1129] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:56 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:56.746416 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a5193c69-8020-4ba8-940d-c4eb90f6f26c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:56.747056 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a5193c69-8020-4ba8-940d-c4eb90f6f26c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:56.753892 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5193c69-8020-4ba8-940d-c4eb90f6f26c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:56.754377 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5193c69-8020-4ba8-940d-c4eb90f6f26c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:56.755150 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5193c69-8020-4ba8-940d-c4eb90f6f26c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:56.755587 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a5193c69-8020-4ba8-940d-c4eb90f6f26c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:56.894766 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a5193c69-8020-4ba8-940d-c4eb90f6f26c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:56.903104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a5193c69-8020-4ba8-940d-c4eb90f6f26c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:56.904625 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a5193c69-8020-4ba8-940d-c4eb90f6f26c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:56.905779 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a5193c69-8020-4ba8-940d-c4eb90f6f26c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.163678 Jul 25 08:57:56.906843 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 580/1130] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:56 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:57.217774 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-539874fa-cfc3-49ce-a1cc-524c8614ea59 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:57.218427 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-539874fa-cfc3-49ce-a1cc-524c8614ea59 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:57.225892 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-539874fa-cfc3-49ce-a1cc-524c8614ea59 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:57.226346 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-539874fa-cfc3-49ce-a1cc-524c8614ea59 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:57.227122 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-539874fa-cfc3-49ce-a1cc-524c8614ea59 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:57.227562 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-539874fa-cfc3-49ce-a1cc-524c8614ea59 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:57.294027 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-539874fa-cfc3-49ce-a1cc-524c8614ea59 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:57.301818 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-539874fa-cfc3-49ce-a1cc-524c8614ea59 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1145 microversion: 2.1 time: 0.087847 Jul 25 08:57:57.302416 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 551/1131] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:57 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:57.931456 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3f53d9a2-2c62-470c-9674-6407099ca835 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:57.932283 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3f53d9a2-2c62-470c-9674-6407099ca835 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:57.939834 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3f53d9a2-2c62-470c-9674-6407099ca835 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:57.940283 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3f53d9a2-2c62-470c-9674-6407099ca835 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:57.941081 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3f53d9a2-2c62-470c-9674-6407099ca835 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:57.941509 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3f53d9a2-2c62-470c-9674-6407099ca835 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:58.080546 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3f53d9a2-2c62-470c-9674-6407099ca835 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:58.089248 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3f53d9a2-2c62-470c-9674-6407099ca835 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:58.091059 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3f53d9a2-2c62-470c-9674-6407099ca835 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:58.092225 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3f53d9a2-2c62-470c-9674-6407099ca835 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.165022 Jul 25 08:57:58.092803 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 581/1132] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:57 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:58.323007 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-76872aef-fd69-4957-8dda-b2856d0fe8ca tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:58.323654 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-76872aef-fd69-4957-8dda-b2856d0fe8ca tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:58.330441 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76872aef-fd69-4957-8dda-b2856d0fe8ca tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:58.331513 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76872aef-fd69-4957-8dda-b2856d0fe8ca tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:58.332301 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76872aef-fd69-4957-8dda-b2856d0fe8ca tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:58.332765 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-76872aef-fd69-4957-8dda-b2856d0fe8ca tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:58.402406 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-76872aef-fd69-4957-8dda-b2856d0fe8ca tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:58.410444 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-76872aef-fd69-4957-8dda-b2856d0fe8ca tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1211 microversion: 2.1 time: 0.091494 Jul 25 08:57:58.424106 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 552/1133] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:58 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:57:59.116546 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-77f8c776-f223-4dc9-ba45-d88701eebd82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:59.117344 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-77f8c776-f223-4dc9-ba45-d88701eebd82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:59.128332 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77f8c776-f223-4dc9-ba45-d88701eebd82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:59.129060 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77f8c776-f223-4dc9-ba45-d88701eebd82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:59.130240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77f8c776-f223-4dc9-ba45-d88701eebd82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:59.130832 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77f8c776-f223-4dc9-ba45-d88701eebd82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:59.385290 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-77f8c776-f223-4dc9-ba45-d88701eebd82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:59.396207 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-77f8c776-f223-4dc9-ba45-d88701eebd82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:59.398007 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-77f8c776-f223-4dc9-ba45-d88701eebd82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:59.399576 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-77f8c776-f223-4dc9-ba45-d88701eebd82 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.286793 Jul 25 08:57:59.412985 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 582/1134] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:57:59 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:57:59.431300 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b99d1f8e-d99d-4fed-aaab-585c9ac2448f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:57:59.431901 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b99d1f8e-d99d-4fed-aaab-585c9ac2448f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:57:59.438723 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b99d1f8e-d99d-4fed-aaab-585c9ac2448f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:59.439171 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b99d1f8e-d99d-4fed-aaab-585c9ac2448f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:59.439947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b99d1f8e-d99d-4fed-aaab-585c9ac2448f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:57:59.440380 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b99d1f8e-d99d-4fed-aaab-585c9ac2448f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:57:59.663160 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b99d1f8e-d99d-4fed-aaab-585c9ac2448f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:57:59.670984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b99d1f8e-d99d-4fed-aaab-585c9ac2448f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.243417 Jul 25 08:57:59.671583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 553/1135] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:57:59 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:00.132771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-397d149b-8640-447c-b981-be01cf0b3603 req-0a3fff03-4dca-49bc-be18-0b9088cc9fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f22e6c-5c89-42ee-90ce-a87e77bfa17b", "name": "network-vif-plugged", "status": "completed", "tag": "68b8d737-1cd3-4135-ad4b-35b7ce49fc3d"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:58:00.144324 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-397d149b-8640-447c-b981-be01cf0b3603 req-0a3fff03-4dca-49bc-be18-0b9088cc9fbb service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:00.144871 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-397d149b-8640-447c-b981-be01cf0b3603 req-0a3fff03-4dca-49bc-be18-0b9088cc9fbb service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:00.157374 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-397d149b-8640-447c-b981-be01cf0b3603 req-0a3fff03-4dca-49bc-be18-0b9088cc9fbb service nova] Creating event network-vif-plugged:68b8d737-1cd3-4135-ad4b-35b7ce49fc3d for instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b on hv-cinder-85084 Jul 25 08:58:00.163380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-397d149b-8640-447c-b981-be01cf0b3603 req-0a3fff03-4dca-49bc-be18-0b9088cc9fbb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040581 Jul 25 08:58:00.164664 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 583/1136] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:00.299675 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-bc35155a-7890-48f5-902b-74c504421847 req-f467a6b1-6317-4c59-958c-32e5f87373c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "885b3722-2c57-4d32-9bf3-9d376ea3c909", "tag": "afb4ee02-4e83-4314-86d8-93c683f82a91"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:58:00.325674 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-bc35155a-7890-48f5-902b-74c504421847 req-f467a6b1-6317-4c59-958c-32e5f87373c1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:00.326130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-bc35155a-7890-48f5-902b-74c504421847 req-f467a6b1-6317-4c59-958c-32e5f87373c1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:00.341951 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-bc35155a-7890-48f5-902b-74c504421847 req-f467a6b1-6317-4c59-958c-32e5f87373c1 service nova] Creating event network-changed:afb4ee02-4e83-4314-86d8-93c683f82a91 for instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 on hv-cinder-85084 Jul 25 08:58:00.347510 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-bc35155a-7890-48f5-902b-74c504421847 req-f467a6b1-6317-4c59-958c-32e5f87373c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063070 Jul 25 08:58:00.348134 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 554/1137] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:00.426964 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ef24bddd-4bf9-4a8c-94c7-5fdeb8e9a915 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:00.427791 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ef24bddd-4bf9-4a8c-94c7-5fdeb8e9a915 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:00.439907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef24bddd-4bf9-4a8c-94c7-5fdeb8e9a915 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:00.441365 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef24bddd-4bf9-4a8c-94c7-5fdeb8e9a915 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:00.442388 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef24bddd-4bf9-4a8c-94c7-5fdeb8e9a915 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:00.442927 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef24bddd-4bf9-4a8c-94c7-5fdeb8e9a915 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:00.661415 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ef24bddd-4bf9-4a8c-94c7-5fdeb8e9a915 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:00.669625 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ef24bddd-4bf9-4a8c-94c7-5fdeb8e9a915 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:00.671131 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ef24bddd-4bf9-4a8c-94c7-5fdeb8e9a915 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:00.672411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ef24bddd-4bf9-4a8c-94c7-5fdeb8e9a915 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.252943 Jul 25 08:58:00.673003 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 584/1138] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:58:00 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:58:00.692174 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-bd9f90e5-f49a-44b9-ae63-65c55499f1d3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:00.692920 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-bd9f90e5-f49a-44b9-ae63-65c55499f1d3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:00.699569 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd9f90e5-f49a-44b9-ae63-65c55499f1d3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:00.700018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd9f90e5-f49a-44b9-ae63-65c55499f1d3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:00.700836 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd9f90e5-f49a-44b9-ae63-65c55499f1d3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:00.701282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-bd9f90e5-f49a-44b9-ae63-65c55499f1d3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:00.839734 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-bd9f90e5-f49a-44b9-ae63-65c55499f1d3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:00.848372 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-bd9f90e5-f49a-44b9-ae63-65c55499f1d3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.160303 Jul 25 08:58:00.849002 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 555/1139] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:00 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:58:01.695696 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1ad61aa2-cd3b-41ce-b41e-e596c91a160c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:01.696626 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1ad61aa2-cd3b-41ce-b41e-e596c91a160c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:01.707185 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ad61aa2-cd3b-41ce-b41e-e596c91a160c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:01.707938 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ad61aa2-cd3b-41ce-b41e-e596c91a160c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:01.716856 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ad61aa2-cd3b-41ce-b41e-e596c91a160c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:01.718084 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ad61aa2-cd3b-41ce-b41e-e596c91a160c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:01.866710 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1ad61aa2-cd3b-41ce-b41e-e596c91a160c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:01.870081 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-56dd3a30-7943-47d3-8bae-aee104a30f9f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:01.871261 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-56dd3a30-7943-47d3-8bae-aee104a30f9f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:01.878288 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-56dd3a30-7943-47d3-8bae-aee104a30f9f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:01.878685 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1ad61aa2-cd3b-41ce-b41e-e596c91a160c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:01.878820 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-56dd3a30-7943-47d3-8bae-aee104a30f9f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:01.879643 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-56dd3a30-7943-47d3-8bae-aee104a30f9f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:01.880076 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-56dd3a30-7943-47d3-8bae-aee104a30f9f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:01.880732 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1ad61aa2-cd3b-41ce-b41e-e596c91a160c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:01.882315 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1ad61aa2-cd3b-41ce-b41e-e596c91a160c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.190961 Jul 25 08:58:01.883272 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 585/1140] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:58:01 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:58:02.034660 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-56dd3a30-7943-47d3-8bae-aee104a30f9f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:02.042433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-56dd3a30-7943-47d3-8bae-aee104a30f9f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.177028 Jul 25 08:58:02.043018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 556/1141] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:01 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:02.907308 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9d00c549-56b3-44d0-89e2-618a5ce8dabe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:02.907908 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9d00c549-56b3-44d0-89e2-618a5ce8dabe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:02.914573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d00c549-56b3-44d0-89e2-618a5ce8dabe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:02.915022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d00c549-56b3-44d0-89e2-618a5ce8dabe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:02.915781 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d00c549-56b3-44d0-89e2-618a5ce8dabe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:02.916216 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d00c549-56b3-44d0-89e2-618a5ce8dabe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:03.056197 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9d00c549-56b3-44d0-89e2-618a5ce8dabe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:03.063754 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1414bba2-e31f-4f2d-abf2-454118346e6b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:03.064522 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1414bba2-e31f-4f2d-abf2-454118346e6b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:03.068664 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9d00c549-56b3-44d0-89e2-618a5ce8dabe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:03.070358 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9d00c549-56b3-44d0-89e2-618a5ce8dabe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:03.071432 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1414bba2-e31f-4f2d-abf2-454118346e6b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:03.071574 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9d00c549-56b3-44d0-89e2-618a5ce8dabe tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1731 microversion: 2.20 time: 0.168732 Jul 25 08:58:03.072059 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1414bba2-e31f-4f2d-abf2-454118346e6b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:03.080891 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 586/1142] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:58:02 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:58:03.081076 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1414bba2-e31f-4f2d-abf2-454118346e6b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:03.081076 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1414bba2-e31f-4f2d-abf2-454118346e6b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:03.211804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1414bba2-e31f-4f2d-abf2-454118346e6b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:03.220093 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1414bba2-e31f-4f2d-abf2-454118346e6b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.160569 Jul 25 08:58:03.233391 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 557/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:03 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:58:04.096239 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-809f5ef5-119b-4705-85cc-54d5f65269cf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:04.096876 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-809f5ef5-119b-4705-85cc-54d5f65269cf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:04.103411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-809f5ef5-119b-4705-85cc-54d5f65269cf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:04.103865 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-809f5ef5-119b-4705-85cc-54d5f65269cf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:04.104655 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-809f5ef5-119b-4705-85cc-54d5f65269cf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:04.105095 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-809f5ef5-119b-4705-85cc-54d5f65269cf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:04.240992 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-187db19d-6c21-4ed4-83bb-dba535513159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:04.241665 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-187db19d-6c21-4ed4-83bb-dba535513159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:04.248831 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-187db19d-6c21-4ed4-83bb-dba535513159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:04.249382 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-187db19d-6c21-4ed4-83bb-dba535513159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:04.250720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-187db19d-6c21-4ed4-83bb-dba535513159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:04.251162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-187db19d-6c21-4ed4-83bb-dba535513159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:04.339870 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-809f5ef5-119b-4705-85cc-54d5f65269cf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:04.348991 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-809f5ef5-119b-4705-85cc-54d5f65269cf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:04.350622 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-809f5ef5-119b-4705-85cc-54d5f65269cf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:04.351873 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-809f5ef5-119b-4705-85cc-54d5f65269cf tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1718 microversion: 2.20 time: 0.260206 Jul 25 08:58:04.352620 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 587/1144] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:58:04 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1718 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:58:04.416519 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-187db19d-6c21-4ed4-83bb-dba535513159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:04.424009 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-187db19d-6c21-4ed4-83bb-dba535513159 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.187210 Jul 25 08:58:04.424606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 558/1145] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:04 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:58:05.444830 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-207cb2af-fe3d-4318-b3ac-c7afda213773 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:05.445444 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-207cb2af-fe3d-4318-b3ac-c7afda213773 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:05.451911 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-207cb2af-fe3d-4318-b3ac-c7afda213773 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:05.452354 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-207cb2af-fe3d-4318-b3ac-c7afda213773 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:05.453660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-207cb2af-fe3d-4318-b3ac-c7afda213773 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:05.454093 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-207cb2af-fe3d-4318-b3ac-c7afda213773 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:05.584489 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-207cb2af-fe3d-4318-b3ac-c7afda213773 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:05.592018 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-207cb2af-fe3d-4318-b3ac-c7afda213773 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.151276 Jul 25 08:58:05.592593 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 588/1146] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:05 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:06.613907 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-810ca2bb-aa74-4362-a0c5-a05256327517 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:06.614618 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-810ca2bb-aa74-4362-a0c5-a05256327517 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:06.621811 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-810ca2bb-aa74-4362-a0c5-a05256327517 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:06.622265 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-810ca2bb-aa74-4362-a0c5-a05256327517 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:06.623047 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-810ca2bb-aa74-4362-a0c5-a05256327517 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:06.623484 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-810ca2bb-aa74-4362-a0c5-a05256327517 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:06.766037 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-810ca2bb-aa74-4362-a0c5-a05256327517 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:06.774012 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-810ca2bb-aa74-4362-a0c5-a05256327517 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.164604 Jul 25 08:58:06.774515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 559/1147] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:06 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:07.796036 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c545723e-87a2-4503-b0dc-5a22fdd040a1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:07.796645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c545723e-87a2-4503-b0dc-5a22fdd040a1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:07.804973 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c545723e-87a2-4503-b0dc-5a22fdd040a1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:07.805425 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c545723e-87a2-4503-b0dc-5a22fdd040a1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:07.806198 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c545723e-87a2-4503-b0dc-5a22fdd040a1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:07.806633 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c545723e-87a2-4503-b0dc-5a22fdd040a1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:08.020797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c545723e-87a2-4503-b0dc-5a22fdd040a1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:08.028849 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c545723e-87a2-4503-b0dc-5a22fdd040a1 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.237399 Jul 25 08:58:08.029432 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 589/1148] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:07 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:09.050734 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4ace136f-eaa1-4bb6-a8f1-eecbbd36cf03 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:09.051354 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-4ace136f-eaa1-4bb6-a8f1-eecbbd36cf03 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:09.058774 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4ace136f-eaa1-4bb6-a8f1-eecbbd36cf03 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:09.059447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4ace136f-eaa1-4bb6-a8f1-eecbbd36cf03 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:09.060443 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4ace136f-eaa1-4bb6-a8f1-eecbbd36cf03 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:09.061142 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-4ace136f-eaa1-4bb6-a8f1-eecbbd36cf03 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:09.203933 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-4ace136f-eaa1-4bb6-a8f1-eecbbd36cf03 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:09.211735 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4ace136f-eaa1-4bb6-a8f1-eecbbd36cf03 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.165624 Jul 25 08:58:09.212312 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 560/1149] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:09 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:10.232938 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-26e0621b-a84d-45cd-bb73-382b81c085c6 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:10.233632 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-26e0621b-a84d-45cd-bb73-382b81c085c6 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:10.241006 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e0621b-a84d-45cd-bb73-382b81c085c6 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:10.241457 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e0621b-a84d-45cd-bb73-382b81c085c6 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:10.242225 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e0621b-a84d-45cd-bb73-382b81c085c6 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:10.242664 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e0621b-a84d-45cd-bb73-382b81c085c6 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:10.395657 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-26e0621b-a84d-45cd-bb73-382b81c085c6 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:10.403327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-26e0621b-a84d-45cd-bb73-382b81c085c6 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.174422 Jul 25 08:58:10.403910 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 590/1150] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:10 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:58:11.425189 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-64034bc8-0900-424b-a65e-e9fa03616e10 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:11.425884 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-64034bc8-0900-424b-a65e-e9fa03616e10 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:11.432960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-64034bc8-0900-424b-a65e-e9fa03616e10 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:11.433415 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-64034bc8-0900-424b-a65e-e9fa03616e10 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:11.434253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-64034bc8-0900-424b-a65e-e9fa03616e10 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:11.434687 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-64034bc8-0900-424b-a65e-e9fa03616e10 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:11.567499 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-64034bc8-0900-424b-a65e-e9fa03616e10 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:11.574944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-64034bc8-0900-424b-a65e-e9fa03616e10 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.154343 Jul 25 08:58:11.575516 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 561/1151] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:11 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:12.595412 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-29b475c6-0c25-4b32-84b0-5d1798f51ed3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:12.596031 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-29b475c6-0c25-4b32-84b0-5d1798f51ed3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:12.602683 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29b475c6-0c25-4b32-84b0-5d1798f51ed3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:12.603154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29b475c6-0c25-4b32-84b0-5d1798f51ed3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:12.603942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29b475c6-0c25-4b32-84b0-5d1798f51ed3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:12.604664 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29b475c6-0c25-4b32-84b0-5d1798f51ed3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:12.790506 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-29b475c6-0c25-4b32-84b0-5d1798f51ed3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:12.799410 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-29b475c6-0c25-4b32-84b0-5d1798f51ed3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.207749 Jul 25 08:58:12.800043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 591/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:12 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:13.825014 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-024551c7-b506-49c1-a3b3-6ea205cc3f8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:13.825661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-024551c7-b506-49c1-a3b3-6ea205cc3f8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:13.832795 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-024551c7-b506-49c1-a3b3-6ea205cc3f8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:13.835314 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-024551c7-b506-49c1-a3b3-6ea205cc3f8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:13.836197 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-024551c7-b506-49c1-a3b3-6ea205cc3f8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:13.836699 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-024551c7-b506-49c1-a3b3-6ea205cc3f8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:13.974530 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-024551c7-b506-49c1-a3b3-6ea205cc3f8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:13.982911 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-024551c7-b506-49c1-a3b3-6ea205cc3f8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.161717 Jul 25 08:58:13.983725 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 562/1153] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:13 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:14.132857 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-38e2723f-c009-4920-8df3-52ce92a8b344 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:14.133704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-38e2723f-c009-4920-8df3-52ce92a8b344 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:14.140665 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38e2723f-c009-4920-8df3-52ce92a8b344 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:14.142439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38e2723f-c009-4920-8df3-52ce92a8b344 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:14.143537 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38e2723f-c009-4920-8df3-52ce92a8b344 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:14.143981 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38e2723f-c009-4920-8df3-52ce92a8b344 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:14.170573 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-38e2723f-c009-4920-8df3-52ce92a8b344 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/ips" status: 200 len: 150 microversion: 2.1 time: 0.041350 Jul 25 08:58:14.171599 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 592/1154] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Jul 25 08:58:14 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:58:14.213532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-a2815dc3-bc66-43d2-8cbe-7d8b6ffe3a7b req-281a9d33-2d67-43b4-a669-55aa595d0552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885b3722-2c57-4d32-9bf3-9d376ea3c909", "name": "network-vif-plugged", "status": "completed", "tag": "afb4ee02-4e83-4314-86d8-93c683f82a91"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:58:14.234737 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-a2815dc3-bc66-43d2-8cbe-7d8b6ffe3a7b req-281a9d33-2d67-43b4-a669-55aa595d0552 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:14.235455 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-a2815dc3-bc66-43d2-8cbe-7d8b6ffe3a7b req-281a9d33-2d67-43b4-a669-55aa595d0552 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:14.260053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-a2815dc3-bc66-43d2-8cbe-7d8b6ffe3a7b req-281a9d33-2d67-43b4-a669-55aa595d0552 service nova] Creating event network-vif-plugged:afb4ee02-4e83-4314-86d8-93c683f82a91 for instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 on hv-cinder-85084 Jul 25 08:58:14.276878 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-a2815dc3-bc66-43d2-8cbe-7d8b6ffe3a7b req-281a9d33-2d67-43b4-a669-55aa595d0552 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082816 Jul 25 08:58:14.286757 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 563/1155] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:15.005082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-69445198-3ce1-455e-b632-5e1c2991fad3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:15.005702 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-69445198-3ce1-455e-b632-5e1c2991fad3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:15.012052 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69445198-3ce1-455e-b632-5e1c2991fad3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:15.012504 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69445198-3ce1-455e-b632-5e1c2991fad3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:15.013333 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69445198-3ce1-455e-b632-5e1c2991fad3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:15.013777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69445198-3ce1-455e-b632-5e1c2991fad3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:15.146952 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-69445198-3ce1-455e-b632-5e1c2991fad3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:15.154808 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-69445198-3ce1-455e-b632-5e1c2991fad3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.153535 Jul 25 08:58:15.155350 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 593/1156] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:14 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:16.177138 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7b82469d-82fc-4c8e-a6e8-b41ea3e7286a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:16.177842 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7b82469d-82fc-4c8e-a6e8-b41ea3e7286a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:16.185180 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7b82469d-82fc-4c8e-a6e8-b41ea3e7286a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:16.185715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7b82469d-82fc-4c8e-a6e8-b41ea3e7286a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:16.186552 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7b82469d-82fc-4c8e-a6e8-b41ea3e7286a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:16.186989 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7b82469d-82fc-4c8e-a6e8-b41ea3e7286a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:16.321042 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7b82469d-82fc-4c8e-a6e8-b41ea3e7286a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:16.328813 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7b82469d-82fc-4c8e-a6e8-b41ea3e7286a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1267 microversion: 2.1 time: 0.156430 Jul 25 08:58:16.329397 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 564/1157] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:16 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:16.665038 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-93a30e96-eb6b-4e7d-b879-5ca9cba36286 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a45752ba-c402-40a8-8d3f-ebfab34f247a"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:58:16.668424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-93a30e96-eb6b-4e7d-b879-5ca9cba36286 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:16.675498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a30e96-eb6b-4e7d-b879-5ca9cba36286 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:16.675921 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a30e96-eb6b-4e7d-b879-5ca9cba36286 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:16.676899 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a30e96-eb6b-4e7d-b879-5ca9cba36286 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:16.677335 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93a30e96-eb6b-4e7d-b879-5ca9cba36286 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:16.680172 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:58:16.947218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-93a30e96-eb6b-4e7d-b879-5ca9cba36286 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "POST /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285851 Jul 25 08:58:16.947994 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 594/1158] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Jul 25 08:58:16 2022] POST /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:17.348296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-cf273dba-c279-405c-94d7-7af540d06d0e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:17.348954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-cf273dba-c279-405c-94d7-7af540d06d0e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:17.355458 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf273dba-c279-405c-94d7-7af540d06d0e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:17.355950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf273dba-c279-405c-94d7-7af540d06d0e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:17.356735 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf273dba-c279-405c-94d7-7af540d06d0e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:17.357164 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cf273dba-c279-405c-94d7-7af540d06d0e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:17.502421 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-cf273dba-c279-405c-94d7-7af540d06d0e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:17.510600 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-cf273dba-c279-405c-94d7-7af540d06d0e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1454 microversion: 2.1 time: 0.166134 Jul 25 08:58:17.511162 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 565/1159] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:17 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:17.532117 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7674eccd-51af-439c-a2a0-cdd78557f9a8 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:17.532863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7674eccd-51af-439c-a2a0-cdd78557f9a8 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:17.534832 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=46 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:58:17.541390 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7674eccd-51af-439c-a2a0-cdd78557f9a8 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:17.541891 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7674eccd-51af-439c-a2a0-cdd78557f9a8 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:17.542692 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7674eccd-51af-439c-a2a0-cdd78557f9a8 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:17.543120 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7674eccd-51af-439c-a2a0-cdd78557f9a8 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:17.686395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7674eccd-51af-439c-a2a0-cdd78557f9a8 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:17.694347 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7674eccd-51af-439c-a2a0-cdd78557f9a8 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1454 microversion: 2.1 time: 0.167089 Jul 25 08:58:17.694929 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 595/1160] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:17 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:19.765087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-1eae9f9e-ccb1-4b30-ba56-4e56d0859934 req-c2d55a4c-657a-44a8-9d05-0cc3d2700f9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "885b3722-2c57-4d32-9bf3-9d376ea3c909", "tag": "afb4ee02-4e83-4314-86d8-93c683f82a91"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:58:19.771186 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=46 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:58:19.777377 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-1eae9f9e-ccb1-4b30-ba56-4e56d0859934 req-c2d55a4c-657a-44a8-9d05-0cc3d2700f9a service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:19.777917 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-1eae9f9e-ccb1-4b30-ba56-4e56d0859934 req-c2d55a4c-657a-44a8-9d05-0cc3d2700f9a service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:19.790309 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-1eae9f9e-ccb1-4b30-ba56-4e56d0859934 req-c2d55a4c-657a-44a8-9d05-0cc3d2700f9a service nova] Creating event network-changed:afb4ee02-4e83-4314-86d8-93c683f82a91 for instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 on hv-cinder-85084 Jul 25 08:58:19.796392 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-1eae9f9e-ccb1-4b30-ba56-4e56d0859934 req-c2d55a4c-657a-44a8-9d05-0cc3d2700f9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035013 Jul 25 08:58:19.798200 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 566/1161] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:24.875181 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-584ba492-1f28-4b7a-a1a3-ea7bfc78715e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:24.875814 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-584ba492-1f28-4b7a-a1a3-ea7bfc78715e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:24.882842 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-584ba492-1f28-4b7a-a1a3-ea7bfc78715e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:24.883298 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-584ba492-1f28-4b7a-a1a3-ea7bfc78715e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:24.884078 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-584ba492-1f28-4b7a-a1a3-ea7bfc78715e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:24.884510 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-584ba492-1f28-4b7a-a1a3-ea7bfc78715e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:24.971618 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-584ba492-1f28-4b7a-a1a3-ea7bfc78715e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lazy-loading 'services' on Instance uuid 94ab586a-09bb-4a39-8da0-2d4c003f5368 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:58:25.046388 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-584ba492-1f28-4b7a-a1a3-ea7bfc78715e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/os-volume_attachments/a45752ba-c402-40a8-8d3f-ebfab34f247a" status: 202 len: 0 microversion: 2.1 time: 0.174978 Jul 25 08:58:25.047005 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 596/1162] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Jul 25 08:58:24 2022] DELETE /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/os-volume_attachments/a45752ba-c402-40a8-8d3f-ebfab34f247a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:58:25.057606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5734383a-3b90-49d3-8938-c0fd2799366f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:25.059927 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5734383a-3b90-49d3-8938-c0fd2799366f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:25.067839 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5734383a-3b90-49d3-8938-c0fd2799366f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:25.068340 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5734383a-3b90-49d3-8938-c0fd2799366f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:25.069305 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5734383a-3b90-49d3-8938-c0fd2799366f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:25.069939 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5734383a-3b90-49d3-8938-c0fd2799366f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:25.106572 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5734383a-3b90-49d3-8938-c0fd2799366f tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054263 Jul 25 08:58:25.107175 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 567/1163] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:58:25 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:26.120942 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0bb9cd27-3bc5-4755-b6c1-3f1366ac01f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:26.123363 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0bb9cd27-3bc5-4755-b6c1-3f1366ac01f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:26.129727 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0bb9cd27-3bc5-4755-b6c1-3f1366ac01f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:26.130185 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0bb9cd27-3bc5-4755-b6c1-3f1366ac01f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:26.130958 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0bb9cd27-3bc5-4755-b6c1-3f1366ac01f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:26.131398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0bb9cd27-3bc5-4755-b6c1-3f1366ac01f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:26.164810 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0bb9cd27-3bc5-4755-b6c1-3f1366ac01f1 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049148 Jul 25 08:58:26.167426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 597/1164] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Jul 25 08:58:26 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 08:58:26.233555 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-484c2c35-614f-4f2a-bd55-f244cc086507 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:26.234138 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-484c2c35-614f-4f2a-bd55-f244cc086507 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:26.241519 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-484c2c35-614f-4f2a-bd55-f244cc086507 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:26.241974 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-484c2c35-614f-4f2a-bd55-f244cc086507 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:26.242834 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-484c2c35-614f-4f2a-bd55-f244cc086507 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:26.243197 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-484c2c35-614f-4f2a-bd55-f244cc086507 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:26.246531 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=97 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:58:26.272689 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-484c2c35-614f-4f2a-bd55-f244cc086507 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:58:26.354160 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-484c2c35-614f-4f2a-bd55-f244cc086507 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 204 len: 0 microversion: 2.1 time: 0.124000 Jul 25 08:58:26.355190 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 568/1165] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:58:26 2022] DELETE /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 08:58:26.364378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a60da447-e36d-4aa5-87c6-c75389a9a4aa tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:26.365106 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a60da447-e36d-4aa5-87c6-c75389a9a4aa tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:26.371899 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a60da447-e36d-4aa5-87c6-c75389a9a4aa tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:26.372543 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a60da447-e36d-4aa5-87c6-c75389a9a4aa tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:26.373205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a60da447-e36d-4aa5-87c6-c75389a9a4aa tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:26.373638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a60da447-e36d-4aa5-87c6-c75389a9a4aa tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:26.510526 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a60da447-e36d-4aa5-87c6-c75389a9a4aa tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:26.518615 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a60da447-e36d-4aa5-87c6-c75389a9a4aa tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1682 microversion: 2.1 time: 0.158327 Jul 25 08:58:26.519176 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 598/1166] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:26 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:58:27.541628 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d4afb0ad-afb9-4131-bcfd-a8109fa41155 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:27.542324 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d4afb0ad-afb9-4131-bcfd-a8109fa41155 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:27.549163 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d4afb0ad-afb9-4131-bcfd-a8109fa41155 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:27.549606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d4afb0ad-afb9-4131-bcfd-a8109fa41155 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:27.550358 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d4afb0ad-afb9-4131-bcfd-a8109fa41155 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:27.550788 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d4afb0ad-afb9-4131-bcfd-a8109fa41155 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:27.695522 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d4afb0ad-afb9-4131-bcfd-a8109fa41155 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:27.703838 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d4afb0ad-afb9-4131-bcfd-a8109fa41155 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1682 microversion: 2.1 time: 0.166902 Jul 25 08:58:27.704417 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 569/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:27 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:28.725044 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b60024fc-362a-4e29-b6f1-1f5ac3a08960 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:28.725693 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b60024fc-362a-4e29-b6f1-1f5ac3a08960 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:28.732655 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b60024fc-362a-4e29-b6f1-1f5ac3a08960 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:28.733119 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b60024fc-362a-4e29-b6f1-1f5ac3a08960 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:28.733895 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b60024fc-362a-4e29-b6f1-1f5ac3a08960 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:28.734327 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b60024fc-362a-4e29-b6f1-1f5ac3a08960 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:28.920379 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b60024fc-362a-4e29-b6f1-1f5ac3a08960 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:28.930434 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b60024fc-362a-4e29-b6f1-1f5ac3a08960 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1682 microversion: 2.1 time: 0.208027 Jul 25 08:58:28.930434 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 599/1168] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:28 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:58:29.951134 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-60a52c19-9003-4ad5-ac2b-0c32f9cb2893 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:29.952414 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-60a52c19-9003-4ad5-ac2b-0c32f9cb2893 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:29.966842 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60a52c19-9003-4ad5-ac2b-0c32f9cb2893 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:29.967377 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60a52c19-9003-4ad5-ac2b-0c32f9cb2893 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:29.968245 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60a52c19-9003-4ad5-ac2b-0c32f9cb2893 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:29.968954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-60a52c19-9003-4ad5-ac2b-0c32f9cb2893 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:30.082837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-60a52c19-9003-4ad5-ac2b-0c32f9cb2893 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e682232b7374450a7265e092602a5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bea90252bc44b580c40b24b0bd4ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:58:30.084427 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-b1f28753-72e9-4005-b5ff-2552dfe7a2e8 req-c80d4c2b-3ff4-4def-90d1-5a1a4faecdd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94ab586a-09bb-4a39-8da0-2d4c003f5368", "name": "network-vif-deleted", "tag": "582537f2-65a5-448b-a06c-d0ebf0814b75"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:58:30.092496 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-60a52c19-9003-4ad5-ac2b-0c32f9cb2893 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 200 len: 1614 microversion: 2.1 time: 0.145561 Jul 25 08:58:30.094115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 570/1169] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:29 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 1614 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:58:30.096987 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-b1f28753-72e9-4005-b5ff-2552dfe7a2e8 req-c80d4c2b-3ff4-4def-90d1-5a1a4faecdd1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:30.097704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-b1f28753-72e9-4005-b5ff-2552dfe7a2e8 req-c80d4c2b-3ff4-4def-90d1-5a1a4faecdd1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:30.110963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-b1f28753-72e9-4005-b5ff-2552dfe7a2e8 req-c80d4c2b-3ff4-4def-90d1-5a1a4faecdd1 service nova] Creating event network-vif-deleted:582537f2-65a5-448b-a06c-d0ebf0814b75 for instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 on hv-cinder-85084 Jul 25 08:58:30.122682 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-b1f28753-72e9-4005-b5ff-2552dfe7a2e8 req-c80d4c2b-3ff4-4def-90d1-5a1a4faecdd1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042911 Jul 25 08:58:30.123922 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 600/1170] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:58:31.115683 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-30694f17-e0ee-489e-ac31-10d5719d97c7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:31.116319 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-30694f17-e0ee-489e-ac31-10d5719d97c7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:31.125267 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30694f17-e0ee-489e-ac31-10d5719d97c7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:31.125859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30694f17-e0ee-489e-ac31-10d5719d97c7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:31.126544 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30694f17-e0ee-489e-ac31-10d5719d97c7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:31.126984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-30694f17-e0ee-489e-ac31-10d5719d97c7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:31.143004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-30694f17-e0ee-489e-ac31-10d5719d97c7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-30694f17-e0ee-489e-ac31-10d5719d97c7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 HTTP/1.1 Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:58:31.144726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:31.146525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '94ab586a-09bb-4a39-8da0-2d4c003f5368'} Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:58:31.147381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:31.148855 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:31.150131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-30694f17-e0ee-489e-ac31-10d5719d97c7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:58:31.150131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-30694f17-e0ee-489e-ac31-10d5719d97c7 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 404 len: 111 microversion: 2.1 time: 0.034597 Jul 25 08:58:31.150131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 571/1171] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:31 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:58:31.158816 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-083a0c3a-a656-4557-8a4d-dc23415a577e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '.version_select at 0x7f0f79a23f70>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:31.182655 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-083a0c3a-a656-4557-8a4d-dc23415a577e tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-616394325" status: 202 len: 0 microversion: 2.1 time: 0.029492 Jul 25 08:58:31.183737 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 601/1172] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Jul 25 08:58:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-616394325 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:58:32.990799 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-23ba11ef-49b0-45f0-b909-ac40e33d42e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:32.991342 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-23ba11ef-49b0-45f0-b909-ac40e33d42e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:32.998787 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-23ba11ef-49b0-45f0-b909-ac40e33d42e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:32.999286 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-23ba11ef-49b0-45f0-b909-ac40e33d42e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:33.000085 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-23ba11ef-49b0-45f0-b909-ac40e33d42e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:33.000520 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-23ba11ef-49b0-45f0-b909-ac40e33d42e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:33.015408 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-23ba11ef-49b0-45f0-b909-ac40e33d42e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-23ba11ef-49b0-45f0-b909-ac40e33d42e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: DELETE /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 HTTP/1.1 Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:58:33.017619 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:33.019278 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '94ab586a-09bb-4a39-8da0-2d4c003f5368'} Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:58:33.020296 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:33.021828 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:33.023361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-23ba11ef-49b0-45f0-b909-ac40e33d42e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:58:33.023361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-23ba11ef-49b0-45f0-b909-ac40e33d42e8 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 404 len: 111 microversion: 2.1 time: 0.032095 Jul 25 08:58:33.023361 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 572/1173] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:58:32 2022] DELETE /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:58:33.027592 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d50e6bf5-15e2-43b6-88e0-c027cf3d0d8d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:33.028329 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d50e6bf5-15e2-43b6-88e0-c027cf3d0d8d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 94ab586a-09bb-4a39-8da0-2d4c003f5368] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:33.036329 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d50e6bf5-15e2-43b6-88e0-c027cf3d0d8d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:33.036843 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d50e6bf5-15e2-43b6-88e0-c027cf3d0d8d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:33.037839 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d50e6bf5-15e2-43b6-88e0-c027cf3d0d8d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:33.038280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d50e6bf5-15e2-43b6-88e0-c027cf3d0d8d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:33.053056 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-d50e6bf5-15e2-43b6-88e0-c027cf3d0d8d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d50e6bf5-15e2-43b6-88e0-c027cf3d0d8d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 HTTP/1.1 Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:58:33.054738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:33.056355 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '94ab586a-09bb-4a39-8da0-2d4c003f5368'} Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:58:33.057285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. Jul 25 08:58:33.058764 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:33.060080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d50e6bf5-15e2-43b6-88e0-c027cf3d0d8d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance 94ab586a-09bb-4a39-8da0-2d4c003f5368 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:58:33.060080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d50e6bf5-15e2-43b6-88e0-c027cf3d0d8d tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368" status: 404 len: 111 microversion: 2.1 time: 0.032441 Jul 25 08:58:33.060080 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 602/1174] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:33 2022] GET /compute/v2.1/servers/94ab586a-09bb-4a39-8da0-2d4c003f5368 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 08:58:34.202833 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b545c792-9793-47b1-9fcf-a01f95f37098 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:34.203546 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b545c792-9793-47b1-9fcf-a01f95f37098 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:34.210897 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b545c792-9793-47b1-9fcf-a01f95f37098 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:34.211344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b545c792-9793-47b1-9fcf-a01f95f37098 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:34.212115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b545c792-9793-47b1-9fcf-a01f95f37098 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:34.212545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b545c792-9793-47b1-9fcf-a01f95f37098 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:34.226322 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-b545c792-9793-47b1-9fcf-a01f95f37098 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b545c792-9793-47b1-9fcf-a01f95f37098 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: DELETE /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff HTTP/1.1 Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:58:34.227923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:58:34.229601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'c5c94565-b030-4cad-a705-425ace6d71ff'} Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:58:34.230433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:58:34.231706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.233105 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b545c792-9793-47b1-9fcf-a01f95f37098 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:58:34.233105 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b545c792-9793-47b1-9fcf-a01f95f37098 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 404 len: 111 microversion: 2.1 time: 0.031680 Jul 25 08:58:34.233105 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 573/1175] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:58:34 2022] DELETE /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:58:34.238359 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-186e5235-885a-4998-8c09-1bb81d6a0b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:34.238976 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-186e5235-885a-4998-8c09-1bb81d6a0b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: c5c94565-b030-4cad-a705-425ace6d71ff] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:34.246301 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-186e5235-885a-4998-8c09-1bb81d6a0b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:34.246723 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-186e5235-885a-4998-8c09-1bb81d6a0b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:34.247480 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-186e5235-885a-4998-8c09-1bb81d6a0b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:34.247924 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-186e5235-885a-4998-8c09-1bb81d6a0b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:34.262490 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-186e5235-885a-4998-8c09-1bb81d6a0b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-186e5235-885a-4998-8c09-1bb81d6a0b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff HTTP/1.1 Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:58:34.264028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:58:34.265647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': 'c5c94565-b030-4cad-a705-425ace6d71ff'} Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:58:34.267161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. Jul 25 08:58:34.268878 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.270401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-186e5235-885a-4998-8c09-1bb81d6a0b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance c5c94565-b030-4cad-a705-425ace6d71ff could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:58:34.270401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-186e5235-885a-4998-8c09-1bb81d6a0b0b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff" status: 404 len: 111 microversion: 2.1 time: 0.031054 Jul 25 08:58:34.270401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 603/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:34 2022] GET /compute/v2.1/servers/c5c94565-b030-4cad-a705-425ace6d71ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:58:34.275601 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2caac7f9-89c9-4ad8-b243-fed4132f0929 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:34.276102 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2caac7f9-89c9-4ad8-b243-fed4132f0929 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:34.283637 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2caac7f9-89c9-4ad8-b243-fed4132f0929 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:34.284089 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2caac7f9-89c9-4ad8-b243-fed4132f0929 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:34.284959 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2caac7f9-89c9-4ad8-b243-fed4132f0929 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:34.285392 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2caac7f9-89c9-4ad8-b243-fed4132f0929 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:34.299606 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-2caac7f9-89c9-4ad8-b243-fed4132f0929 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2caac7f9-89c9-4ad8-b243-fed4132f0929 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: DELETE /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 HTTP/1.1 Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:58:34.301205 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:58:34.302861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': 'd5263978-0aac-41bf-adad-05221bb69a08'} Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:58:34.303705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:58:34.304994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.306260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2caac7f9-89c9-4ad8-b243-fed4132f0929 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:58:34.306260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2caac7f9-89c9-4ad8-b243-fed4132f0929 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 404 len: 111 microversion: 2.1 time: 0.030823 Jul 25 08:58:34.306260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 574/1177] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:58:34 2022] DELETE /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:58:34.311934 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3aa9e221-9a70-46a8-afbc-b1515ca22ee9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:34.312551 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3aa9e221-9a70-46a8-afbc-b1515ca22ee9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: d5263978-0aac-41bf-adad-05221bb69a08] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:34.322754 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3aa9e221-9a70-46a8-afbc-b1515ca22ee9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:34.323238 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3aa9e221-9a70-46a8-afbc-b1515ca22ee9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:34.324063 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3aa9e221-9a70-46a8-afbc-b1515ca22ee9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:34.324533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3aa9e221-9a70-46a8-afbc-b1515ca22ee9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:34.339488 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-3aa9e221-9a70-46a8-afbc-b1515ca22ee9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3aa9e221-9a70-46a8-afbc-b1515ca22ee9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 HTTP/1.1 Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:58:34.341112 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:58:34.342733 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': 'd5263978-0aac-41bf-adad-05221bb69a08'} Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:58:34.343660 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. Jul 25 08:58:34.345151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:34.346524 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3aa9e221-9a70-46a8-afbc-b1515ca22ee9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance d5263978-0aac-41bf-adad-05221bb69a08 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:58:34.346524 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3aa9e221-9a70-46a8-afbc-b1515ca22ee9 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08" status: 404 len: 111 microversion: 2.1 time: 0.034407 Jul 25 08:58:34.346524 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 604/1178] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:34 2022] GET /compute/v2.1/servers/d5263978-0aac-41bf-adad-05221bb69a08 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:58:35.485905 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f05f4772-feb4-4044-bbab-0c8052195c9b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:35.486403 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f05f4772-feb4-4044-bbab-0c8052195c9b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:35.492952 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f05f4772-feb4-4044-bbab-0c8052195c9b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:35.493397 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f05f4772-feb4-4044-bbab-0c8052195c9b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:35.494163 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f05f4772-feb4-4044-bbab-0c8052195c9b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:35.494602 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f05f4772-feb4-4044-bbab-0c8052195c9b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:35.508982 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-f05f4772-feb4-4044-bbab-0c8052195c9b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f05f4772-feb4-4044-bbab-0c8052195c9b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: DELETE /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e HTTP/1.1 Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:58:35.510556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:58:35.512184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '51386e27-02e7-4b3c-8a7a-a13ede11e75e'} Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:58:35.513057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:58:35.514469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:58:35.515758 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f05f4772-feb4-4044-bbab-0c8052195c9b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:58:35.515758 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f05f4772-feb4-4044-bbab-0c8052195c9b tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 404 len: 111 microversion: 2.1 time: 0.029907 Jul 25 08:58:35.515758 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 575/1179] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 08:58:35 2022] DELETE /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:58:35.521378 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fa5f9e09-d56d-470e-a350-fe2baeebc838 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:35.521995 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fa5f9e09-d56d-470e-a350-fe2baeebc838 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] [instance: 51386e27-02e7-4b3c-8a7a-a13ede11e75e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:58:35.528751 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa5f9e09-d56d-470e-a350-fe2baeebc838 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:35.529198 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa5f9e09-d56d-470e-a350-fe2baeebc838 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:35.529961 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa5f9e09-d56d-470e-a350-fe2baeebc838 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:58:35.530393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa5f9e09-d56d-470e-a350-fe2baeebc838 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:58:35.544807 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-fa5f9e09-d56d-470e-a350-fe2baeebc838 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] HTTP exception thrown: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fa5f9e09-d56d-470e-a350-fe2baeebc838 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Request method failure captured: Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e HTTP/1.1 Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lhEJVh4QEik1YJUsMowSbFA_qWwdBPCvEekvN9eU68SwhAppGN_VDqstL4dyDeINpEdrSYOg_b0Dqs9OQfH7C7ed4Xdehnv0Kji9xcKdnyW9vSRUaGKlba2Tz-lamRrna8INWtdA7B-H8snPb0qOzdpjvVz_8WLgDejY6Oae45Frwg Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:58:35.546339 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86bea90252bc44b580c40b24b0bd4ed3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86bea90252bc44b580c40b24b0bd4ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86bea90252bc44b580c40b24b0bd4ed3"}]}] Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 86bea90252bc44b580c40b24b0bd4ed3 Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444658846 Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 8e682232b7374450a7265e092602a5a6 Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1444658846-project Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:58:35.547951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '51386e27-02e7-4b3c-8a7a-a13ede11e75e'} Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:58:35.548896 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. Jul 25 08:58:35.550392 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:35.551769 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fa5f9e09-d56d-470e-a350-fe2baeebc838 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] Returning 404 to user: Instance 51386e27-02e7-4b3c-8a7a-a13ede11e75e could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:58:35.551769 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fa5f9e09-d56d-470e-a350-fe2baeebc838 tempest-AttachVolumeNegativeTest-1444658846 tempest-AttachVolumeNegativeTest-1444658846-project] 10.222.0.52 "GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e" status: 404 len: 111 microversion: 2.1 time: 0.030977 Jul 25 08:58:35.551769 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 605/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:58:35 2022] GET /compute/v2.1/servers/51386e27-02e7-4b3c-8a7a-a13ede11e75e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:58:40.169232 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b40d548c-3d52-4832-af8b-50961c70d2e0 tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] Action: 'create', calling method: .version_select at 0x7f0f797f49d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-38836199", "metadata": {"Type": "work"}}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:58:40.479066 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b40d548c-3d52-4832-af8b-50961c70d2e0 tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.427140 Jul 25 08:58:40.479705 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 576/1181] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Jul 25 08:58:40 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 429 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 08:58:40.492893 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-96ccd0e5-1165-4de6-81f3-5a8312c57788 tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] Calling method '.version_select at 0x7f0f79b60160>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:40.545271 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-96ccd0e5-1165-4de6-81f3-5a8312c57788 tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56" status: 200 len: 351 microversion: 2.1 time: 0.056206 Jul 25 08:58:40.545835 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 606/1182] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:58:40 2022] GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:41.559694 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a5243f79-f94e-40f3-b1be-67f68ee4180e tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] Calling method '.version_select at 0x7f0f797980d0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:41.609785 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a5243f79-f94e-40f3-b1be-67f68ee4180e tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56" status: 200 len: 351 microversion: 2.1 time: 0.054312 Jul 25 08:58:41.610919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 577/1183] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:58:41 2022] GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:42.627296 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f8a9ef67-42e7-4a02-846c-46761e6ba827 tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] Calling method '.version_select at 0x7f0f79a239d0>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:42.674521 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f8a9ef67-42e7-4a02-846c-46761e6ba827 tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56" status: 200 len: 352 microversion: 2.1 time: 0.051751 Jul 25 08:58:42.675083 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 607/1184] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:58:42 2022] GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:42.687645 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-30dcd2ad-af03-4e8e-803e-f3efd49758c0 tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] Calling method '.version_select at 0x7f0f79d1a430>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:42.736184 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-30dcd2ad-af03-4e8e-803e-f3efd49758c0 tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56" status: 200 len: 352 microversion: 2.1 time: 0.052217 Jul 25 08:58:42.736826 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 578/1185] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:58:42 2022] GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:42.754523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9fbdef5d-2f92-4c17-9e6e-61ba3a9b23ec tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] Calling method '.version_select at 0x7f0f79b55430>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:42.819482 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9fbdef5d-2f92-4c17-9e6e-61ba3a9b23ec tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56" status: 202 len: 0 microversion: 2.1 time: 0.068749 Jul 25 08:58:42.820042 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 608/1186] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Jul 25 08:58:42 2022] DELETE /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 08:58:42.829460 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7548662d-6c97-4d49-be46-93b2fc2f0933 tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] Calling method '.version_select at 0x7f0f797f41f0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:42.882841 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7548662d-6c97-4d49-be46-93b2fc2f0933 tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56" status: 200 len: 351 microversion: 2.1 time: 0.058527 Jul 25 08:58:42.883443 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 579/1187] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:58:42 2022] GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:58:43.897414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aed44eb1-8ed8-4007-b129-433df4dc79fe tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] Calling method '.version_select at 0x7f0f79a23e50>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:58:43.926201 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-aed44eb1-8ed8-4007-b129-433df4dc79fe tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] HTTP exception thrown: Volume 77bb8742-a9a3-48a1-b0a1-37111c800b56 could not be found. Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aed44eb1-8ed8-4007-b129-433df4dc79fe tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] Request method failure captured: Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56 HTTP/1.1 Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3ls_AR-KTt47WF3P3O0m10MyCk53Xu5au_wUanwh5uzRrMF0AKYxPxsQGFD2F52Jux43Mcpr5ZK6DMHNHITv11NNj_CCHkQ2zkjDgrxngVqF-Qd340UpQrnluMlcDSENwSRbemvoWLaIRBu_nR0JBbniXX6eWPY81f0BeL2ZJkCRLxA Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 9084169d0b4a4e1986c30416b9413f33 Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesGetTestJSON-703662102 Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:58:43.928141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9084169d0b4a4e1986c30416b9413f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9084169d0b4a4e1986c30416b9413f33", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9084169d0b4a4e1986c30416b9413f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9084169d0b4a4e1986c30416b9413f33"}]}] Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesGetTestJSON-703662102 Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 9084169d0b4a4e1986c30416b9413f33 Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesGetTestJSON-703662102 Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesGetTestJSON-703662102-project Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: ea33b7ac96ef47a2b1739e5a90353f82 Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesGetTestJSON-703662102-project Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Volume 77bb8742-a9a3-48a1-b0a1-37111c800b56 could not be found. Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '77bb8742-a9a3-48a1-b0a1-37111c800b56'} Jul 25 08:58:43.929787 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77bb8742-a9a3-48a1-b0a1-37111c800b56 could not be found. (HTTP 404) (Request-ID: req-02ab7ed9-c3f0-46da-891e-cfd1795eefa8) Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:43.930824 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 08:58:43.932259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77bb8742-a9a3-48a1-b0a1-37111c800b56 could not be found. Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 08:58:43.933771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77bb8742-a9a3-48a1-b0a1-37111c800b56 could not be found. Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77bb8742-a9a3-48a1-b0a1-37111c800b56 could not be found. Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aed44eb1-8ed8-4007-b129-433df4dc79fe tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] Returning 404 to user: Volume 77bb8742-a9a3-48a1-b0a1-37111c800b56 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-aed44eb1-8ed8-4007-b129-433df4dc79fe tempest-VolumesGetTestJSON-703662102 tempest-VolumesGetTestJSON-703662102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56" status: 404 len: 109 microversion: 2.1 time: 0.036808 Jul 25 08:58:43.935240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 609/1188] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Jul 25 08:58:43 2022] GET /compute/v2.1/os-volumes/77bb8742-a9a3-48a1-b0a1-37111c800b56 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 08:59:14.692720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:14.693640 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:14.935711 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-abb073de-8d23-4caa-a86e-09c4e6cc2e27 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Action: 'create', calling method: .version_select at 0x7f0f797f5820>, body: {"keypair": {"name": "tempest-TestShelveInstance-328740924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYmqB3jOd1Y2EJJ0oMrrYGNHaUEOB8kKHwyqizRXtFlvXDau12UNzrfe0V9qRNa/P2gDmcVhTNHTIWaICSdVtWXwLVP3fsLVBTZnBpFmxfp1UvU54W2373JO/tZUeQ/cA=="}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:59:14.954007 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-abb073de-8d23-4caa-a86e-09c4e6cc2e27 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Getting quotas for project 4a77723e8867459c99fcd86914fa44df. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:59:14.958972 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.quota [None req-abb073de-8d23-4caa-a86e-09c4e6cc2e27 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Getting quotas for user 52e9d0e3c2dd453eb4bfc2db6b45d80f and project 4a77723e8867459c99fcd86914fa44df. Resources: {'key_pairs'} {{(pid=124234) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:59:14.989873 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-abb073de-8d23-4caa-a86e-09c4e6cc2e27 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.299466 Jul 25 08:59:14.991193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 580/1189] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Jul 25 08:59:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:59:35.232817 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:35.233689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:35.239676 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fce0bf1f-329b-4236-8eeb-48a291413c36 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:35.241877 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fce0bf1f-329b-4236-8eeb-48a291413c36 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:35.251116 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fce0bf1f-329b-4236-8eeb-48a291413c36 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:35.251568 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fce0bf1f-329b-4236-8eeb-48a291413c36 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:35.252351 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fce0bf1f-329b-4236-8eeb-48a291413c36 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:35.252831 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fce0bf1f-329b-4236-8eeb-48a291413c36 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:35.283698 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fce0bf1f-329b-4236-8eeb-48a291413c36 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052643 Jul 25 08:59:35.284290 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 610/1190] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Jul 25 08:59:35 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:35.348280 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=4 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:35.349074 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:35.353382 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d7b0f9aa-5f67-42e8-bbe8-33c46f679ef2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:35.353884 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d7b0f9aa-5f67-42e8-bbe8-33c46f679ef2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:35.361353 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d7b0f9aa-5f67-42e8-bbe8-33c46f679ef2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:35.361804 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d7b0f9aa-5f67-42e8-bbe8-33c46f679ef2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:35.363079 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d7b0f9aa-5f67-42e8-bbe8-33c46f679ef2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:35.363525 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d7b0f9aa-5f67-42e8-bbe8-33c46f679ef2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:35.390648 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d7b0f9aa-5f67-42e8-bbe8-33c46f679ef2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 08:59:35.470018 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d7b0f9aa-5f67-42e8-bbe8-33c46f679ef2 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 204 len: 0 microversion: 2.20 time: 0.122651 Jul 25 08:59:35.470822 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 581/1191] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Jul 25 08:59:35 2022] DELETE /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 08:59:35.479312 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-307b261d-8331-4687-b935-3b7fecf2f440 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:35.479921 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-307b261d-8331-4687-b935-3b7fecf2f440 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:35.486071 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-307b261d-8331-4687-b935-3b7fecf2f440 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:35.486523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-307b261d-8331-4687-b935-3b7fecf2f440 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:35.487773 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-307b261d-8331-4687-b935-3b7fecf2f440 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:35.488214 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-307b261d-8331-4687-b935-3b7fecf2f440 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:35.622681 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-307b261d-8331-4687-b935-3b7fecf2f440 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:35.630762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-307b261d-8331-4687-b935-3b7fecf2f440 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:35.632268 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-307b261d-8331-4687-b935-3b7fecf2f440 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:35.633459 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-307b261d-8331-4687-b935-3b7fecf2f440 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.158069 Jul 25 08:59:35.634056 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 611/1192] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:59:35 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:59:36.657645 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b8834473-a572-4087-9ef9-872227199805 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:36.658341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b8834473-a572-4087-9ef9-872227199805 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:36.665114 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8834473-a572-4087-9ef9-872227199805 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:36.665574 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8834473-a572-4087-9ef9-872227199805 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:36.666330 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8834473-a572-4087-9ef9-872227199805 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:36.667260 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b8834473-a572-4087-9ef9-872227199805 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:36.803566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b8834473-a572-4087-9ef9-872227199805 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:36.811728 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b8834473-a572-4087-9ef9-872227199805 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:36.813264 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b8834473-a572-4087-9ef9-872227199805 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:36.814429 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b8834473-a572-4087-9ef9-872227199805 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.161023 Jul 25 08:59:36.814997 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 582/1193] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:59:36 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:59:37.838425 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c0403567-8219-493d-bab0-c390dedb1bae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:37.839028 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c0403567-8219-493d-bab0-c390dedb1bae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:37.845645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0403567-8219-493d-bab0-c390dedb1bae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:37.846091 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0403567-8219-493d-bab0-c390dedb1bae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:37.847451 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0403567-8219-493d-bab0-c390dedb1bae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:37.848441 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0403567-8219-493d-bab0-c390dedb1bae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:38.070405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c0403567-8219-493d-bab0-c390dedb1bae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:38.079193 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c0403567-8219-493d-bab0-c390dedb1bae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:38.080770 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c0403567-8219-493d-bab0-c390dedb1bae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:38.082566 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c0403567-8219-493d-bab0-c390dedb1bae tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1724 microversion: 2.20 time: 0.248125 Jul 25 08:59:38.083140 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 612/1194] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:59:37 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:59:38.948391 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-3e90fa8a-d464-4b4c-b629-46d50de2b488 req-3074173d-d2d3-4997-b71a-26db0c996979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f22e6c-5c89-42ee-90ce-a87e77bfa17b", "name": "network-vif-deleted", "tag": "68b8d737-1cd3-4135-ad4b-35b7ce49fc3d"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:59:38.970125 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-3e90fa8a-d464-4b4c-b629-46d50de2b488 req-3074173d-d2d3-4997-b71a-26db0c996979 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:38.970930 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-3e90fa8a-d464-4b4c-b629-46d50de2b488 req-3074173d-d2d3-4997-b71a-26db0c996979 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:38.986218 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-3e90fa8a-d464-4b4c-b629-46d50de2b488 req-3074173d-d2d3-4997-b71a-26db0c996979 service nova] Creating event network-vif-deleted:68b8d737-1cd3-4135-ad4b-35b7ce49fc3d for instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b on hv-cinder-85084 Jul 25 08:59:38.991831 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-3e90fa8a-d464-4b4c-b629-46d50de2b488 req-3074173d-d2d3-4997-b71a-26db0c996979 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204546 Jul 25 08:59:38.993215 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 583/1195] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:59:39.106441 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:39.107056 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:39.114095 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:39.114465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:39.115314 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:39.115746 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:39.157294 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:39.158232 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:39.159043 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lazy-loading 'fault' on Instance uuid 51f22e6c-5c89-42ee-90ce-a87e77bfa17b {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 08:59:39.211694 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:39.221106 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:39.223653 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f0b30685e94f83883d682731644a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3491b85dc4543c88f500828b2df1d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:39.224864 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1caabd26-bee3-4aef-a286-60b8590e0280 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 200 len: 1371 microversion: 2.20 time: 0.122503 Jul 25 08:59:39.225424 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 613/1196] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:59:39 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 1371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 08:59:40.250053 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ee507b08-5fa2-45ae-8d38-155a26250e0f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:40.250860 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ee507b08-5fa2-45ae-8d38-155a26250e0f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:40.257387 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ee507b08-5fa2-45ae-8d38-155a26250e0f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:40.257926 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ee507b08-5fa2-45ae-8d38-155a26250e0f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:40.258780 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ee507b08-5fa2-45ae-8d38-155a26250e0f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:40.259295 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ee507b08-5fa2-45ae-8d38-155a26250e0f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:40.264175 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-174229886", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-328740924", "security_groups": [{"name": "tempest-secgroup-smoke-1559255574"}], "networks": [{"uuid": "35257166-0377-42b7-b5ee-f1f63f121fe2"}], "block_device_mapping_v2": [{"uuid": "dca234e3-2ec9-4274-aaf3-1cabf65d80ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:59:40.273399 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-ee507b08-5fa2-45ae-8d38-155a26250e0f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] HTTP exception thrown: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ee507b08-5fa2-45ae-8d38-155a26250e0f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Request method failure captured: Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b HTTP/1.1 Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3ljXeGfpqo7VsdKdZFWk-ck-vjZvkTI9CRcLQ8SwqCZh0_Y3_JEP-2cjx4iPgyIE_spioJ3QFnioU5XpxqrDViGGWnPMwv4SJjGF9Pa_VlpZfquYbcLLCYOQxywXVxokFHY949BKpr5UUHPS7inOR31GZUYfdFwXm5OWxcGNQcNHoEU Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:59:40.275233 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3491b85dc4543c88f500828b2df1d2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}] Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: d3f0b30685e94f83883d682731644a89 Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:40.277587 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '51f22e6c-5c89-42ee-90ce-a87e77bfa17b'} Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:59:40.278495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:40.279938 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:40.282364 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ee507b08-5fa2-45ae-8d38-155a26250e0f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Returning 404 to user: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:59:40.282364 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ee507b08-5fa2-45ae-8d38-155a26250e0f tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 404 len: 111 microversion: 2.20 time: 0.032018 Jul 25 08:59:40.282364 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 584/1197] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:59:40 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 08:59:40.286462 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-385d013e-eaeb-4602-b2e0-f5a80c5ac49c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '.version_select at 0x7f0f797883a0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:40.309466 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-385d013e-eaeb-4602-b2e0-f5a80c5ac49c tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251652066" status: 204 len: 0 microversion: 2.20 time: 0.027283 Jul 25 08:59:40.310037 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 585/1198] 10.222.0.52 () {60 vars in 1262 bytes} [Mon Jul 25 08:59:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251652066 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 08:59:40.398912 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] validate_networks() for [('35257166-0377-42b7-b5ee-f1f63f121fe2', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 08:59:40.889303 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 08:59:40.889950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 08:59:40.890687 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 08:59:40.891166 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 08:59:40.891646 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 08:59:40.903599 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:40.903599 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:40.903962 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:40.904082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:40.921638 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Getting quotas for project 4a77723e8867459c99fcd86914fa44df. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 08:59:40.925778 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Getting quotas for user 52e9d0e3c2dd453eb4bfc2db6b45d80f and project 4a77723e8867459c99fcd86914fa44df. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 08:59:40.987367 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 08:59:40.989498 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dca234e3-2ec9-4274-aaf3-1cabf65d80ea',volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 08:59:41.130634 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b202a92d-6515-451f-b979-6bb41283d380 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.870193 Jul 25 08:59:41.131279 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 614/1199] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 08:59:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 08:59:41.142086 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-668a0e1a-39b5-4b54-ae40-78b90101b2e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:41.142726 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-668a0e1a-39b5-4b54-ae40-78b90101b2e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:41.202863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-668a0e1a-39b5-4b54-ae40-78b90101b2e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:41.210013 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-668a0e1a-39b5-4b54-ae40-78b90101b2e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1087 microversion: 2.1 time: 0.071771 Jul 25 08:59:41.210583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 586/1200] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:41 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:42.117163 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fd82a7c1-7c42-4b1b-aa8a-8f52ecaf442e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:42.117758 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fd82a7c1-7c42-4b1b-aa8a-8f52ecaf442e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:42.124437 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd82a7c1-7c42-4b1b-aa8a-8f52ecaf442e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:42.124925 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd82a7c1-7c42-4b1b-aa8a-8f52ecaf442e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:42.125888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd82a7c1-7c42-4b1b-aa8a-8f52ecaf442e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:42.126335 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd82a7c1-7c42-4b1b-aa8a-8f52ecaf442e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:42.140917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-fd82a7c1-7c42-4b1b-aa8a-8f52ecaf442e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] HTTP exception thrown: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fd82a7c1-7c42-4b1b-aa8a-8f52ecaf442e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Request method failure captured: Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: DELETE /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b HTTP/1.1 Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3ljXeGfpqo7VsdKdZFWk-ck-vjZvkTI9CRcLQ8SwqCZh0_Y3_JEP-2cjx4iPgyIE_spioJ3QFnioU5XpxqrDViGGWnPMwv4SJjGF9Pa_VlpZfquYbcLLCYOQxywXVxokFHY949BKpr5UUHPS7inOR31GZUYfdFwXm5OWxcGNQcNHoEU Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 08:59:42.142495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3491b85dc4543c88f500828b2df1d2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}] Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: d3f0b30685e94f83883d682731644a89 Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:42.144380 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '51f22e6c-5c89-42ee-90ce-a87e77bfa17b'} Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:59:42.145405 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:42.146749 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 08:59:42.148159 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fd82a7c1-7c42-4b1b-aa8a-8f52ecaf442e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Returning 404 to user: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:59:42.148159 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fd82a7c1-7c42-4b1b-aa8a-8f52ecaf442e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 404 len: 111 microversion: 2.20 time: 0.031841 Jul 25 08:59:42.148159 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 615/1201] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Jul 25 08:59:42 2022] DELETE /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 08:59:42.153236 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-89cab0c6-36a2-4cb0-ac59-554529f5f6ea tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:42.153960 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-89cab0c6-36a2-4cb0-ac59-554529f5f6ea tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 51f22e6c-5c89-42ee-90ce-a87e77bfa17b] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:42.161663 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89cab0c6-36a2-4cb0-ac59-554529f5f6ea tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:42.162109 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89cab0c6-36a2-4cb0-ac59-554529f5f6ea tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:42.162879 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89cab0c6-36a2-4cb0-ac59-554529f5f6ea tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:42.163309 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-89cab0c6-36a2-4cb0-ac59-554529f5f6ea tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:42.178425 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-89cab0c6-36a2-4cb0-ac59-554529f5f6ea tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] HTTP exception thrown: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-89cab0c6-36a2-4cb0-ac59-554529f5f6ea tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Request method failure captured: Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b HTTP/1.1 Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3ljXeGfpqo7VsdKdZFWk-ck-vjZvkTI9CRcLQ8SwqCZh0_Y3_JEP-2cjx4iPgyIE_spioJ3QFnioU5XpxqrDViGGWnPMwv4SJjGF9Pa_VlpZfquYbcLLCYOQxywXVxokFHY949BKpr5UUHPS7inOR31GZUYfdFwXm5OWxcGNQcNHoEU Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:59:42.180004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3491b85dc4543c88f500828b2df1d2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}] Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: d3f0b30685e94f83883d682731644a89 Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:42.181532 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '51f22e6c-5c89-42ee-90ce-a87e77bfa17b'} Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:59:42.182888 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. Jul 25 08:59:42.184527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:42.186558 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-89cab0c6-36a2-4cb0-ac59-554529f5f6ea tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Returning 404 to user: Instance 51f22e6c-5c89-42ee-90ce-a87e77bfa17b could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:59:42.186558 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-89cab0c6-36a2-4cb0-ac59-554529f5f6ea tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b" status: 404 len: 111 microversion: 2.20 time: 0.032090 Jul 25 08:59:42.186558 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 587/1202] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:59:42 2022] GET /compute/v2.1/servers/51f22e6c-5c89-42ee-90ce-a87e77bfa17b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 08:59:42.234431 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ff9f49d7-eeec-402d-bdac-65aabdc02768 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:42.235667 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ff9f49d7-eeec-402d-bdac-65aabdc02768 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:42.242811 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff9f49d7-eeec-402d-bdac-65aabdc02768 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:42.243464 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff9f49d7-eeec-402d-bdac-65aabdc02768 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:42.244234 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff9f49d7-eeec-402d-bdac-65aabdc02768 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:42.244729 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff9f49d7-eeec-402d-bdac-65aabdc02768 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:42.337775 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ff9f49d7-eeec-402d-bdac-65aabdc02768 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:42.347261 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ff9f49d7-eeec-402d-bdac-65aabdc02768 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1203 microversion: 2.1 time: 0.118884 Jul 25 08:59:42.347848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 616/1203] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:42 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1203 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:43.348017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-67c785f5-9caf-469f-a416-1faf5933c70e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:43.349144 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-67c785f5-9caf-469f-a416-1faf5933c70e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:43.359167 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67c785f5-9caf-469f-a416-1faf5933c70e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:43.359690 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67c785f5-9caf-469f-a416-1faf5933c70e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:43.360471 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67c785f5-9caf-469f-a416-1faf5933c70e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:43.360982 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-67c785f5-9caf-469f-a416-1faf5933c70e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:43.368714 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6297f3d0-1e8e-4208-8d10-df61aa33e93e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:43.370137 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6297f3d0-1e8e-4208-8d10-df61aa33e93e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:43.378509 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-67c785f5-9caf-469f-a416-1faf5933c70e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] HTTP exception thrown: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-67c785f5-9caf-469f-a416-1faf5933c70e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Request method failure captured: Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: DELETE /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda HTTP/1.1 Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3ljXeGfpqo7VsdKdZFWk-ck-vjZvkTI9CRcLQ8SwqCZh0_Y3_JEP-2cjx4iPgyIE_spioJ3QFnioU5XpxqrDViGGWnPMwv4SJjGF9Pa_VlpZfquYbcLLCYOQxywXVxokFHY949BKpr5UUHPS7inOR31GZUYfdFwXm5OWxcGNQcNHoEU Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:59:43.380341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3491b85dc4543c88f500828b2df1d2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}] Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: d3f0b30685e94f83883d682731644a89 Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:59:43.382021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '7b4a347c-82ac-48e1-a31e-45f7eb643cda'} Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:59:43.383094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:59:43.384703 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:43.386219 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-67c785f5-9caf-469f-a416-1faf5933c70e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Returning 404 to user: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:59:43.386219 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-67c785f5-9caf-469f-a416-1faf5933c70e tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 404 len: 111 microversion: 2.20 time: 0.037806 Jul 25 08:59:43.386219 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 588/1204] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Jul 25 08:59:43 2022] DELETE /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 08:59:43.390752 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6297f3d0-1e8e-4208-8d10-df61aa33e93e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:43.391203 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6297f3d0-1e8e-4208-8d10-df61aa33e93e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:43.391977 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6297f3d0-1e8e-4208-8d10-df61aa33e93e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:43.392633 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6297f3d0-1e8e-4208-8d10-df61aa33e93e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:43.395809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fb0494e0-5b43-474f-b57d-f6eb4e7587a1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:43.396899 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fb0494e0-5b43-474f-b57d-f6eb4e7587a1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] [instance: 7b4a347c-82ac-48e1-a31e-45f7eb643cda] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:43.404944 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fb0494e0-5b43-474f-b57d-f6eb4e7587a1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:43.405679 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fb0494e0-5b43-474f-b57d-f6eb4e7587a1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:43.406648 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fb0494e0-5b43-474f-b57d-f6eb4e7587a1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:43.407246 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fb0494e0-5b43-474f-b57d-f6eb4e7587a1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:43.426131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-fb0494e0-5b43-474f-b57d-f6eb4e7587a1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] HTTP exception thrown: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fb0494e0-5b43-474f-b57d-f6eb4e7587a1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Request method failure captured: Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda HTTP/1.1 Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3ljXeGfpqo7VsdKdZFWk-ck-vjZvkTI9CRcLQ8SwqCZh0_Y3_JEP-2cjx4iPgyIE_spioJ3QFnioU5XpxqrDViGGWnPMwv4SJjGF9Pa_VlpZfquYbcLLCYOQxywXVxokFHY949BKpr5UUHPS7inOR31GZUYfdFwXm5OWxcGNQcNHoEU Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 08:59:43.427990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3491b85dc4543c88f500828b2df1d2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3491b85dc4543c88f500828b2df1d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3491b85dc4543c88f500828b2df1d2d"}]}] Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: f3491b85dc4543c88f500828b2df1d2d Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773816903 Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: d3f0b30685e94f83883d682731644a89 Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773816903-project Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:59:43.429790 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '7b4a347c-82ac-48e1-a31e-45f7eb643cda'} Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 08:59:43.430715 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. Jul 25 08:59:43.432229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 08:59:43.434528 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fb0494e0-5b43-474f-b57d-f6eb4e7587a1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] Returning 404 to user: Instance 7b4a347c-82ac-48e1-a31e-45f7eb643cda could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 08:59:43.435558 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fb0494e0-5b43-474f-b57d-f6eb4e7587a1 tempest-AttachVolumeShelveTestJSON-1773816903 tempest-AttachVolumeShelveTestJSON-1773816903-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda" status: 404 len: 111 microversion: 2.20 time: 0.047522 Jul 25 08:59:43.451480 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 589/1205] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Jul 25 08:59:43 2022] GET /compute/v2.1/servers/7b4a347c-82ac-48e1-a31e-45f7eb643cda => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 08:59:43.661127 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6297f3d0-1e8e-4208-8d10-df61aa33e93e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:43.669797 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6297f3d0-1e8e-4208-8d10-df61aa33e93e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.305172 Jul 25 08:59:43.670479 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 617/1206] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:43 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:44.069803 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-6257d949-8898-4f29-b012-960211d95ccb req-8d5dd8e8-b488-4ce0-9c9c-eb89f48524c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43dee25d-a829-4ade-b3e3-05a11ae3d650", "tag": "b087c389-b3fd-48fa-8487-06d1bd3360c7"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:59:44.085640 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-6257d949-8898-4f29-b012-960211d95ccb req-8d5dd8e8-b488-4ce0-9c9c-eb89f48524c1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:44.086394 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-6257d949-8898-4f29-b012-960211d95ccb req-8d5dd8e8-b488-4ce0-9c9c-eb89f48524c1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:44.123507 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-6257d949-8898-4f29-b012-960211d95ccb req-8d5dd8e8-b488-4ce0-9c9c-eb89f48524c1 service nova] Creating event network-changed:b087c389-b3fd-48fa-8487-06d1bd3360c7 for instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 on hv-cinder-85084 Jul 25 08:59:44.130113 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-6257d949-8898-4f29-b012-960211d95ccb req-8d5dd8e8-b488-4ce0-9c9c-eb89f48524c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070907 Jul 25 08:59:44.131303 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 590/1207] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 08:59:44.697744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-747fd361-b1ed-49a9-8af1-558e773a9175 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:44.698414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-747fd361-b1ed-49a9-8af1-558e773a9175 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:44.707759 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-747fd361-b1ed-49a9-8af1-558e773a9175 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:44.708937 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-747fd361-b1ed-49a9-8af1-558e773a9175 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:44.710220 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-747fd361-b1ed-49a9-8af1-558e773a9175 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:44.710965 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-747fd361-b1ed-49a9-8af1-558e773a9175 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:44.856217 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-747fd361-b1ed-49a9-8af1-558e773a9175 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:44.864608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-747fd361-b1ed-49a9-8af1-558e773a9175 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.171598 Jul 25 08:59:44.865288 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 618/1208] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:44 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:45.887447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e98a5b4e-5b95-4852-9e05-78d796222333 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:45.888150 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e98a5b4e-5b95-4852-9e05-78d796222333 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:45.895640 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e98a5b4e-5b95-4852-9e05-78d796222333 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:45.896140 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e98a5b4e-5b95-4852-9e05-78d796222333 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:45.896865 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e98a5b4e-5b95-4852-9e05-78d796222333 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:45.897486 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e98a5b4e-5b95-4852-9e05-78d796222333 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:46.129347 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e98a5b4e-5b95-4852-9e05-78d796222333 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:46.137344 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e98a5b4e-5b95-4852-9e05-78d796222333 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.255097 Jul 25 08:59:46.137905 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 591/1209] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:45 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:47.158372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-90ad4744-7357-41c4-abd4-d18bfc1dd63f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:47.159098 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-90ad4744-7357-41c4-abd4-d18bfc1dd63f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:47.165763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90ad4744-7357-41c4-abd4-d18bfc1dd63f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:47.166215 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90ad4744-7357-41c4-abd4-d18bfc1dd63f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:47.166992 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90ad4744-7357-41c4-abd4-d18bfc1dd63f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:47.167427 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90ad4744-7357-41c4-abd4-d18bfc1dd63f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:47.317795 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-90ad4744-7357-41c4-abd4-d18bfc1dd63f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:47.325337 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-90ad4744-7357-41c4-abd4-d18bfc1dd63f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.170821 Jul 25 08:59:47.325912 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 619/1210] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:47 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:48.347966 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7ccca829-df86-4036-9c44-1dada4cb45e1 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:48.349104 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7ccca829-df86-4036-9c44-1dada4cb45e1 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:48.356772 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7ccca829-df86-4036-9c44-1dada4cb45e1 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:48.357519 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7ccca829-df86-4036-9c44-1dada4cb45e1 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:48.358001 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7ccca829-df86-4036-9c44-1dada4cb45e1 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:48.358434 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7ccca829-df86-4036-9c44-1dada4cb45e1 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:48.501948 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7ccca829-df86-4036-9c44-1dada4cb45e1 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:48.510192 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7ccca829-df86-4036-9c44-1dada4cb45e1 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.167467 Jul 25 08:59:48.510778 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 592/1211] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:48 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:49.531576 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-692f09ff-9594-40cf-88cd-c7de7548e3d2 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:49.532200 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-692f09ff-9594-40cf-88cd-c7de7548e3d2 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:49.548720 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-692f09ff-9594-40cf-88cd-c7de7548e3d2 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:49.549154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-692f09ff-9594-40cf-88cd-c7de7548e3d2 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:49.550477 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-692f09ff-9594-40cf-88cd-c7de7548e3d2 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:49.550907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-692f09ff-9594-40cf-88cd-c7de7548e3d2 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:49.709393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-692f09ff-9594-40cf-88cd-c7de7548e3d2 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:49.717695 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-692f09ff-9594-40cf-88cd-c7de7548e3d2 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.190097 Jul 25 08:59:49.730703 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 620/1212] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:49 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:50.739213 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e3ad0630-053c-4946-89a9-3c645338fa8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:50.739937 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e3ad0630-053c-4946-89a9-3c645338fa8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:50.746883 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3ad0630-053c-4946-89a9-3c645338fa8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:50.747326 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3ad0630-053c-4946-89a9-3c645338fa8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:50.748088 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3ad0630-053c-4946-89a9-3c645338fa8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:50.748522 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e3ad0630-053c-4946-89a9-3c645338fa8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:50.899335 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e3ad0630-053c-4946-89a9-3c645338fa8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:50.907239 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e3ad0630-053c-4946-89a9-3c645338fa8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.172642 Jul 25 08:59:50.907830 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 593/1213] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:50 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:51.928888 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3b543849-3038-4f48-b7ef-4fab7cee0e0c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:51.929503 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3b543849-3038-4f48-b7ef-4fab7cee0e0c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:51.933098 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:51.933964 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:51.938470 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3b543849-3038-4f48-b7ef-4fab7cee0e0c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:51.938925 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3b543849-3038-4f48-b7ef-4fab7cee0e0c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:51.939701 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3b543849-3038-4f48-b7ef-4fab7cee0e0c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:51.940904 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3b543849-3038-4f48-b7ef-4fab7cee0e0c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:52.165752 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3b543849-3038-4f48-b7ef-4fab7cee0e0c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:52.176115 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3b543849-3038-4f48-b7ef-4fab7cee0e0c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.251459 Jul 25 08:59:52.176735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 621/1214] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:51 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:53.197596 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-74191327-e1d5-4385-8820-ab8a03d8fa4f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:53.198378 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-74191327-e1d5-4385-8820-ab8a03d8fa4f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:53.200251 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:53.208295 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-74191327-e1d5-4385-8820-ab8a03d8fa4f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:53.209875 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-74191327-e1d5-4385-8820-ab8a03d8fa4f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:53.210670 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-74191327-e1d5-4385-8820-ab8a03d8fa4f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:53.211355 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-74191327-e1d5-4385-8820-ab8a03d8fa4f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:53.351987 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-74191327-e1d5-4385-8820-ab8a03d8fa4f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:53.360405 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-74191327-e1d5-4385-8820-ab8a03d8fa4f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.166802 Jul 25 08:59:53.361033 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 594/1215] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:53 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:54.382774 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-88d2e915-380f-4a6f-8830-89da36cecb8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:54.383375 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-88d2e915-380f-4a6f-8830-89da36cecb8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:54.390237 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88d2e915-380f-4a6f-8830-89da36cecb8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:54.390689 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88d2e915-380f-4a6f-8830-89da36cecb8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:54.391458 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88d2e915-380f-4a6f-8830-89da36cecb8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:54.391889 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88d2e915-380f-4a6f-8830-89da36cecb8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:54.542104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-88d2e915-380f-4a6f-8830-89da36cecb8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:54.554756 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-88d2e915-380f-4a6f-8830-89da36cecb8c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.175725 Jul 25 08:59:54.568682 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 622/1216] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:54 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:54.588000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-d26b5750-bf2c-49b3-ad14-361ef5b13438 req-8bc73d91-43e7-4007-8243-8123d954850a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43dee25d-a829-4ade-b3e3-05a11ae3d650", "name": "network-vif-plugged", "status": "completed", "tag": "b087c389-b3fd-48fa-8487-06d1bd3360c7"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:59:54.601551 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-d26b5750-bf2c-49b3-ad14-361ef5b13438 req-8bc73d91-43e7-4007-8243-8123d954850a service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:54.602004 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-d26b5750-bf2c-49b3-ad14-361ef5b13438 req-8bc73d91-43e7-4007-8243-8123d954850a service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:54.613807 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-d26b5750-bf2c-49b3-ad14-361ef5b13438 req-8bc73d91-43e7-4007-8243-8123d954850a service nova] Creating event network-vif-plugged:b087c389-b3fd-48fa-8487-06d1bd3360c7 for instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 on hv-cinder-85084 Jul 25 08:59:54.619375 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-d26b5750-bf2c-49b3-ad14-361ef5b13438 req-8bc73d91-43e7-4007-8243-8123d954850a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034990 Jul 25 08:59:54.621029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 595/1217] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 08:59:55.577597 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d35f2cec-3662-4118-bd69-3e083f153f02 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:55.578375 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d35f2cec-3662-4118-bd69-3e083f153f02 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:55.586951 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d35f2cec-3662-4118-bd69-3e083f153f02 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:55.587536 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d35f2cec-3662-4118-bd69-3e083f153f02 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:55.588437 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d35f2cec-3662-4118-bd69-3e083f153f02 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:55.589011 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d35f2cec-3662-4118-bd69-3e083f153f02 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:55.741102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d35f2cec-3662-4118-bd69-3e083f153f02 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:55.749051 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d35f2cec-3662-4118-bd69-3e083f153f02 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1259 microversion: 2.1 time: 0.175840 Jul 25 08:59:55.750069 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 623/1218] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:55 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:56.772899 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5a9f0e7d-c391-44a0-80f8-46ca87509fd8 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:56.773723 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5a9f0e7d-c391-44a0-80f8-46ca87509fd8 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:56.780157 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5a9f0e7d-c391-44a0-80f8-46ca87509fd8 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:56.780777 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5a9f0e7d-c391-44a0-80f8-46ca87509fd8 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:56.781735 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5a9f0e7d-c391-44a0-80f8-46ca87509fd8 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:56.782234 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5a9f0e7d-c391-44a0-80f8-46ca87509fd8 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:56.933050 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5a9f0e7d-c391-44a0-80f8-46ca87509fd8 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:56.941398 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5a9f0e7d-c391-44a0-80f8-46ca87509fd8 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1443 microversion: 2.1 time: 0.173592 Jul 25 08:59:56.942094 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 596/1219] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:56 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1443 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 08:59:56.964859 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c207ee51-a7c2-4b28-b52a-46ce04a6c77c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 08:59:56.965565 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c207ee51-a7c2-4b28-b52a-46ce04a6c77c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 08:59:56.972869 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c207ee51-a7c2-4b28-b52a-46ce04a6c77c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:56.973318 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c207ee51-a7c2-4b28-b52a-46ce04a6c77c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:56.974087 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c207ee51-a7c2-4b28-b52a-46ce04a6c77c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:56.974518 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c207ee51-a7c2-4b28-b52a-46ce04a6c77c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:57.112803 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c207ee51-a7c2-4b28-b52a-46ce04a6c77c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 08:59:57.122138 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c207ee51-a7c2-4b28-b52a-46ce04a6c77c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1443 microversion: 2.1 time: 0.163378 Jul 25 08:59:57.122725 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 624/1220] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 08:59:56 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 08:59:59.399452 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-7a4d69f2-c0b1-4163-a96f-7f10bb74b0dc req-1a15127e-91a4-410b-9e41-054a2125360c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43dee25d-a829-4ade-b3e3-05a11ae3d650", "tag": "b087c389-b3fd-48fa-8487-06d1bd3360c7"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 08:59:59.410695 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-7a4d69f2-c0b1-4163-a96f-7f10bb74b0dc req-1a15127e-91a4-410b-9e41-054a2125360c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 08:59:59.411523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-7a4d69f2-c0b1-4163-a96f-7f10bb74b0dc req-1a15127e-91a4-410b-9e41-054a2125360c service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 08:59:59.424341 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-7a4d69f2-c0b1-4163-a96f-7f10bb74b0dc req-1a15127e-91a4-410b-9e41-054a2125360c service nova] Creating event network-changed:b087c389-b3fd-48fa-8487-06d1bd3360c7 for instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 on hv-cinder-85084 Jul 25 08:59:59.430966 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-7a4d69f2-c0b1-4163-a96f-7f10bb74b0dc req-1a15127e-91a4-410b-9e41-054a2125360c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035044 Jul 25 08:59:59.434924 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 597/1221] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 08:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:00:58.914581 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:00:58.915203 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Mon Jul 25 09:00:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:01:01.689939 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:01.690683 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=84 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:01.694744 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fd511cf6-e5ab-4f7f-9ce1-03b94dc4ccd7 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:01.695238 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fd511cf6-e5ab-4f7f-9ce1-03b94dc4ccd7 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:01.702539 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd511cf6-e5ab-4f7f-9ce1-03b94dc4ccd7 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:01.702986 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd511cf6-e5ab-4f7f-9ce1-03b94dc4ccd7 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:01.703741 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd511cf6-e5ab-4f7f-9ce1-03b94dc4ccd7 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:01.704191 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd511cf6-e5ab-4f7f-9ce1-03b94dc4ccd7 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:01.729495 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fd511cf6-e5ab-4f7f-9ce1-03b94dc4ccd7 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 09:01:01.806465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fd511cf6-e5ab-4f7f-9ce1-03b94dc4ccd7 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "DELETE /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 204 len: 0 microversion: 2.1 time: 0.118120 Jul 25 09:01:01.807055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 625/1222] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 09:01:01 2022] DELETE /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 09:01:01.814023 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:01.814704 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:01.819409 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7c1a668e-49a9-4969-a139-3d3737548943 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:01.820107 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7c1a668e-49a9-4969-a139-3d3737548943 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:01.828381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7c1a668e-49a9-4969-a139-3d3737548943 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:01.828859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7c1a668e-49a9-4969-a139-3d3737548943 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:01.829617 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7c1a668e-49a9-4969-a139-3d3737548943 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:01.830042 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7c1a668e-49a9-4969-a139-3d3737548943 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:02.114119 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7c1a668e-49a9-4969-a139-3d3737548943 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:02.121872 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7c1a668e-49a9-4969-a139-3d3737548943 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1579 microversion: 2.1 time: 0.310243 Jul 25 09:01:02.122445 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 598/1223] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:01 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1579 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:03.143645 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f0b03dcc-6703-4235-9806-c735a9b5aa84 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:03.144377 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f0b03dcc-6703-4235-9806-c735a9b5aa84 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:03.151503 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f0b03dcc-6703-4235-9806-c735a9b5aa84 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:03.151952 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f0b03dcc-6703-4235-9806-c735a9b5aa84 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:03.152742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f0b03dcc-6703-4235-9806-c735a9b5aa84 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:03.153181 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f0b03dcc-6703-4235-9806-c735a9b5aa84 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:03.343340 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f0b03dcc-6703-4235-9806-c735a9b5aa84 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:03.351529 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f0b03dcc-6703-4235-9806-c735a9b5aa84 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1579 microversion: 2.1 time: 0.212095 Jul 25 09:01:03.352088 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 626/1224] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:03 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1579 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:04.372254 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e7913cd2-7630-4659-9e26-be865761056b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:04.373435 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e7913cd2-7630-4659-9e26-be865761056b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:04.379523 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7913cd2-7630-4659-9e26-be865761056b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:04.379977 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7913cd2-7630-4659-9e26-be865761056b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:04.380774 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7913cd2-7630-4659-9e26-be865761056b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:04.381211 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e7913cd2-7630-4659-9e26-be865761056b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:04.477239 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e7913cd2-7630-4659-9e26-be865761056b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:04.484735 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e7913cd2-7630-4659-9e26-be865761056b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 200 len: 1511 microversion: 2.1 time: 0.116625 Jul 25 09:01:04.485531 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 599/1225] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:04 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 1511 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:04.555295 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-17d69625-b9ee-42df-96bf-4f341efb8073 req-c891d774-8d8b-4e0d-a23a-5772e8555596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885b3722-2c57-4d32-9bf3-9d376ea3c909", "name": "network-vif-deleted", "tag": "afb4ee02-4e83-4314-86d8-93c683f82a91"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:01:04.567176 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-17d69625-b9ee-42df-96bf-4f341efb8073 req-c891d774-8d8b-4e0d-a23a-5772e8555596 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:04.567704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-17d69625-b9ee-42df-96bf-4f341efb8073 req-c891d774-8d8b-4e0d-a23a-5772e8555596 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:04.579916 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-17d69625-b9ee-42df-96bf-4f341efb8073 req-c891d774-8d8b-4e0d-a23a-5772e8555596 service nova] Creating event network-vif-deleted:afb4ee02-4e83-4314-86d8-93c683f82a91 for instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 on hv-cinder-85084 Jul 25 09:01:04.590628 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-17d69625-b9ee-42df-96bf-4f341efb8073 req-c891d774-8d8b-4e0d-a23a-5772e8555596 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039551 Jul 25 09:01:04.591812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 627/1226] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:01:05.505630 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-80bbd8ee-3a32-4dd9-beab-eb15c303d572 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:05.506925 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-80bbd8ee-3a32-4dd9-beab-eb15c303d572 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:05.513660 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-80bbd8ee-3a32-4dd9-beab-eb15c303d572 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:05.514112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-80bbd8ee-3a32-4dd9-beab-eb15c303d572 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:05.514891 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-80bbd8ee-3a32-4dd9-beab-eb15c303d572 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:05.515327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-80bbd8ee-3a32-4dd9-beab-eb15c303d572 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:05.529898 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-80bbd8ee-3a32-4dd9-beab-eb15c303d572 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] HTTP exception thrown: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-80bbd8ee-3a32-4dd9-beab-eb15c303d572 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Request method failure captured: Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 HTTP/1.1 Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lrf_Us6LQfgCPS2Lj5X24QVojjPdXJFkjziH5-YqSiHhsohlVOfXiQ-CA822z6sqEihVSpHzuOee-ua7B3lSpVG3apushh1ap5_jwHIYK8xGYdm7H_W1aXnPnygNyP_IAPFv9PLMzNt8pAN2BD022MNjixSYmWsMPUoTAIHmig2Gz4 Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 5005a107ff1940908069356c788185f6 Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 09:01:05.531566 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5005a107ff1940908069356c788185f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5005a107ff1940908069356c788185f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5005a107ff1940908069356c788185f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5005a107ff1940908069356c788185f6"}]}] Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 5005a107ff1940908069356c788185f6 Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-TestVolumeBootPattern-1324447603-project Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: a1a3d224feb94a1baa75a03bc8d1132a Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-TestVolumeBootPattern-1324447603-project Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:01:05.533193 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '885b3722-2c57-4d32-9bf3-9d376ea3c909'} Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 09:01:05.534244 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:01:05.535720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 09:01:05.537039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-80bbd8ee-3a32-4dd9-beab-eb15c303d572 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Returning 404 to user: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 09:01:05.537039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-80bbd8ee-3a32-4dd9-beab-eb15c303d572 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 404 len: 111 microversion: 2.1 time: 0.031339 Jul 25 09:01:05.537407 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 600/1227] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:05 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 09:01:05.635808 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2084923243", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1342922356", "security_groups": [{"name": "tempest-secgroup-smoke-2078811933"}], "block_device_mapping_v2": [{"uuid": "7d1c8f04-0ce4-4f32-8541-64b404b2884a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1708f1a6-6a61-4ee3-995b-a3b155211357"}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:01:05.750804 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] validate_networks() for [('1708f1a6-6a61-4ee3-995b-a3b155211357', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 09:01:06.110919 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 09:01:06.111341 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 09:01:06.111812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 09:01:06.112216 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 09:01:06.112654 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 09:01:06.122154 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:06.122602 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:06.123385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:06.123818 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:06.140863 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Getting quotas for project 5005a107ff1940908069356c788185f6. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 09:01:06.144741 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Getting quotas for user a1a3d224feb94a1baa75a03bc8d1132a and project 5005a107ff1940908069356c788185f6. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 09:01:06.202904 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 09:01:06.205109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d1c8f04-0ce4-4f32-8541-64b404b2884a',volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 09:01:06.329675 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b4f8d79d-36ce-4e1e-bbfe-738840fb72eb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.698622 Jul 25 09:01:06.330486 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 628/1228] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 09:01:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 09:01:06.341446 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-20542323-8f28-47ca-8d6c-e3c58f78597a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:06.342159 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-20542323-8f28-47ca-8d6c-e3c58f78597a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:06.397353 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-20542323-8f28-47ca-8d6c-e3c58f78597a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:06.404258 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-20542323-8f28-47ca-8d6c-e3c58f78597a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1095 microversion: 2.1 time: 0.066772 Jul 25 09:01:06.405419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 601/1229] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:06 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:07.425282 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d56afdc2-f2d4-4980-8889-f4d620e21ef2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:07.425981 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d56afdc2-f2d4-4980-8889-f4d620e21ef2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:07.433069 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d56afdc2-f2d4-4980-8889-f4d620e21ef2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:07.433593 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d56afdc2-f2d4-4980-8889-f4d620e21ef2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:07.434422 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d56afdc2-f2d4-4980-8889-f4d620e21ef2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:07.434921 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d56afdc2-f2d4-4980-8889-f4d620e21ef2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:07.552121 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d56afdc2-f2d4-4980-8889-f4d620e21ef2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:07.560204 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d56afdc2-f2d4-4980-8889-f4d620e21ef2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1211 microversion: 2.1 time: 0.139372 Jul 25 09:01:07.560816 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 629/1230] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:07 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:08.581592 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-7ed4d133-3d56-4693-a6d0-7a5c66753ad9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:08.582243 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-7ed4d133-3d56-4693-a6d0-7a5c66753ad9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:08.589767 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7ed4d133-3d56-4693-a6d0-7a5c66753ad9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:08.590234 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7ed4d133-3d56-4693-a6d0-7a5c66753ad9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:08.591032 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7ed4d133-3d56-4693-a6d0-7a5c66753ad9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:08.591466 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-7ed4d133-3d56-4693-a6d0-7a5c66753ad9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:08.799474 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-7ed4d133-3d56-4693-a6d0-7a5c66753ad9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:08.810646 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-7ed4d133-3d56-4693-a6d0-7a5c66753ad9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.232709 Jul 25 09:01:08.811654 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 602/1231] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:08 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:09.015054 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-f08808f9-e971-47d3-86ca-f58fe3ea56ac req-3e6e50f8-3b80-40cd-9533-e7815b720a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d52410-e972-457b-8d59-076ed8047b9f", "tag": "a5c293c4-0d71-4560-bd24-a3ca240a65f8"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:01:09.028249 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-f08808f9-e971-47d3-86ca-f58fe3ea56ac req-3e6e50f8-3b80-40cd-9533-e7815b720a5d service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:09.028786 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-f08808f9-e971-47d3-86ca-f58fe3ea56ac req-3e6e50f8-3b80-40cd-9533-e7815b720a5d service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:09.043427 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-f08808f9-e971-47d3-86ca-f58fe3ea56ac req-3e6e50f8-3b80-40cd-9533-e7815b720a5d service nova] Creating event network-changed:a5c293c4-0d71-4560-bd24-a3ca240a65f8 for instance 98d52410-e972-457b-8d59-076ed8047b9f on hv-cinder-85084 Jul 25 09:01:09.050508 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-f08808f9-e971-47d3-86ca-f58fe3ea56ac req-3e6e50f8-3b80-40cd-9533-e7815b720a5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042216 Jul 25 09:01:09.051243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 630/1232] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 09:01:09.831431 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f30485eb-f416-4a9b-a331-9e12b5b5c555 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:09.832056 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f30485eb-f416-4a9b-a331-9e12b5b5c555 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:09.838899 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f30485eb-f416-4a9b-a331-9e12b5b5c555 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:09.839352 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f30485eb-f416-4a9b-a331-9e12b5b5c555 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:09.840124 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f30485eb-f416-4a9b-a331-9e12b5b5c555 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:09.840593 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f30485eb-f416-4a9b-a331-9e12b5b5c555 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:09.969465 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f30485eb-f416-4a9b-a331-9e12b5b5c555 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:09.976975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f30485eb-f416-4a9b-a331-9e12b5b5c555 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.149387 Jul 25 09:01:09.977540 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 603/1233] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:09 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:10.998399 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a7e76811-0c98-4da2-ab32-af7c8300b783 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:10.999141 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a7e76811-0c98-4da2-ab32-af7c8300b783 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:11.006350 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a7e76811-0c98-4da2-ab32-af7c8300b783 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:11.006819 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a7e76811-0c98-4da2-ab32-af7c8300b783 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:11.007584 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a7e76811-0c98-4da2-ab32-af7c8300b783 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:11.008024 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a7e76811-0c98-4da2-ab32-af7c8300b783 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:11.143131 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a7e76811-0c98-4da2-ab32-af7c8300b783 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:11.151611 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a7e76811-0c98-4da2-ab32-af7c8300b783 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.157884 Jul 25 09:01:11.152204 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 631/1234] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:10 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:12.171306 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a13dc068-0f70-4015-9d85-11ecb18d09cd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:12.171919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a13dc068-0f70-4015-9d85-11ecb18d09cd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:12.178435 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a13dc068-0f70-4015-9d85-11ecb18d09cd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:12.178881 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a13dc068-0f70-4015-9d85-11ecb18d09cd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:12.180130 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a13dc068-0f70-4015-9d85-11ecb18d09cd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:12.180586 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a13dc068-0f70-4015-9d85-11ecb18d09cd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:12.310600 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a13dc068-0f70-4015-9d85-11ecb18d09cd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:12.318029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a13dc068-0f70-4015-9d85-11ecb18d09cd tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.150550 Jul 25 09:01:12.318603 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 604/1235] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:12 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:13.338893 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-02f67b0a-04fc-40d6-9faf-019c9537a0a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:13.339507 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-02f67b0a-04fc-40d6-9faf-019c9537a0a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:13.346055 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-02f67b0a-04fc-40d6-9faf-019c9537a0a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:13.346502 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-02f67b0a-04fc-40d6-9faf-019c9537a0a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:13.347259 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-02f67b0a-04fc-40d6-9faf-019c9537a0a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:13.347693 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-02f67b0a-04fc-40d6-9faf-019c9537a0a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:13.474890 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-02f67b0a-04fc-40d6-9faf-019c9537a0a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:13.482188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-02f67b0a-04fc-40d6-9faf-019c9537a0a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.147788 Jul 25 09:01:13.482738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 632/1236] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:13 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:14.503142 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-270bcb44-447a-412e-8a24-6db0c3cc59b0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:14.503765 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-270bcb44-447a-412e-8a24-6db0c3cc59b0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:14.510738 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-270bcb44-447a-412e-8a24-6db0c3cc59b0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:14.511191 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-270bcb44-447a-412e-8a24-6db0c3cc59b0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:14.511957 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-270bcb44-447a-412e-8a24-6db0c3cc59b0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:14.512395 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-270bcb44-447a-412e-8a24-6db0c3cc59b0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:14.650128 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-270bcb44-447a-412e-8a24-6db0c3cc59b0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:14.657489 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-270bcb44-447a-412e-8a24-6db0c3cc59b0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.158234 Jul 25 09:01:14.658057 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 605/1237] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:14 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:15.677559 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-eefbc150-4660-40c9-ac21-29b8a97d74d2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:15.678169 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-eefbc150-4660-40c9-ac21-29b8a97d74d2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:15.684654 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eefbc150-4660-40c9-ac21-29b8a97d74d2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:15.685102 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eefbc150-4660-40c9-ac21-29b8a97d74d2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:15.685891 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eefbc150-4660-40c9-ac21-29b8a97d74d2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:15.686324 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eefbc150-4660-40c9-ac21-29b8a97d74d2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:15.822198 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-eefbc150-4660-40c9-ac21-29b8a97d74d2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:15.829631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-eefbc150-4660-40c9-ac21-29b8a97d74d2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.155869 Jul 25 09:01:15.830190 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 633/1238] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:15 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:16.850868 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e4188282-9d8b-440c-bc50-74876f53afa3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:16.851475 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e4188282-9d8b-440c-bc50-74876f53afa3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:16.853806 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:16.858978 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e4188282-9d8b-440c-bc50-74876f53afa3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:16.859419 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e4188282-9d8b-440c-bc50-74876f53afa3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:16.860273 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e4188282-9d8b-440c-bc50-74876f53afa3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:16.860740 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e4188282-9d8b-440c-bc50-74876f53afa3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:16.997105 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e4188282-9d8b-440c-bc50-74876f53afa3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:17.004527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e4188282-9d8b-440c-bc50-74876f53afa3 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.157511 Jul 25 09:01:17.005316 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 606/1239] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:16 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:18.025548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-06d28bb4-8903-46f1-abe5-a3fee5e93004 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:18.026160 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-06d28bb4-8903-46f1-abe5-a3fee5e93004 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:18.028111 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:18.028826 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:18.034937 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06d28bb4-8903-46f1-abe5-a3fee5e93004 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:18.035389 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06d28bb4-8903-46f1-abe5-a3fee5e93004 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:18.036144 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06d28bb4-8903-46f1-abe5-a3fee5e93004 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:18.036647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06d28bb4-8903-46f1-abe5-a3fee5e93004 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:18.164236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-06d28bb4-8903-46f1-abe5-a3fee5e93004 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:18.171757 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-06d28bb4-8903-46f1-abe5-a3fee5e93004 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.149961 Jul 25 09:01:18.172240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 634/1240] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:18 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 09:01:19.000684 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-cc95718e-5477-4734-9e4f-35d397b28f75 req-6bb52467-9595-41de-a5c2-6f89b54acc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d52410-e972-457b-8d59-076ed8047b9f", "name": "network-vif-plugged", "status": "completed", "tag": "a5c293c4-0d71-4560-bd24-a3ca240a65f8"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:01:19.011912 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-cc95718e-5477-4734-9e4f-35d397b28f75 req-6bb52467-9595-41de-a5c2-6f89b54acc57 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:19.011912 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-cc95718e-5477-4734-9e4f-35d397b28f75 req-6bb52467-9595-41de-a5c2-6f89b54acc57 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:19.025335 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-cc95718e-5477-4734-9e4f-35d397b28f75 req-6bb52467-9595-41de-a5c2-6f89b54acc57 service nova] Creating event network-vif-plugged:a5c293c4-0d71-4560-bd24-a3ca240a65f8 for instance 98d52410-e972-457b-8d59-076ed8047b9f on hv-cinder-85084 Jul 25 09:01:19.030389 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-cc95718e-5477-4734-9e4f-35d397b28f75 req-6bb52467-9595-41de-a5c2-6f89b54acc57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033646 Jul 25 09:01:19.031115 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 607/1241] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:01:19.192711 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fc6c3d95-c7c7-4afc-8313-be3276739f9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:19.193359 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fc6c3d95-c7c7-4afc-8313-be3276739f9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:19.200516 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fc6c3d95-c7c7-4afc-8313-be3276739f9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:19.201058 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fc6c3d95-c7c7-4afc-8313-be3276739f9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:19.201849 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fc6c3d95-c7c7-4afc-8313-be3276739f9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:19.202295 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fc6c3d95-c7c7-4afc-8313-be3276739f9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:19.392331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fc6c3d95-c7c7-4afc-8313-be3276739f9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:19.400428 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fc6c3d95-c7c7-4afc-8313-be3276739f9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.211722 Jul 25 09:01:19.401024 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 635/1242] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:19 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 09:01:20.421913 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-72c3b94d-4cbb-4aa5-95a6-2b235eb4bab5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:20.422609 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-72c3b94d-4cbb-4aa5-95a6-2b235eb4bab5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:20.428783 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72c3b94d-4cbb-4aa5-95a6-2b235eb4bab5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:20.429236 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72c3b94d-4cbb-4aa5-95a6-2b235eb4bab5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:20.429996 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72c3b94d-4cbb-4aa5-95a6-2b235eb4bab5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:20.430431 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-72c3b94d-4cbb-4aa5-95a6-2b235eb4bab5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:20.561044 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-72c3b94d-4cbb-4aa5-95a6-2b235eb4bab5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:20.568555 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-72c3b94d-4cbb-4aa5-95a6-2b235eb4bab5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1267 microversion: 2.1 time: 0.151258 Jul 25 09:01:20.569149 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 608/1243] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:20 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:21.589697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5b43e3e2-980e-469e-9594-4687b2ae7a8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:21.590226 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5b43e3e2-980e-469e-9594-4687b2ae7a8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:21.597504 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5b43e3e2-980e-469e-9594-4687b2ae7a8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:21.597956 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5b43e3e2-980e-469e-9594-4687b2ae7a8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:21.598715 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5b43e3e2-980e-469e-9594-4687b2ae7a8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:21.599150 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5b43e3e2-980e-469e-9594-4687b2ae7a8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:21.730941 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5b43e3e2-980e-469e-9594-4687b2ae7a8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:21.739109 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5b43e3e2-980e-469e-9594-4687b2ae7a8b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1454 microversion: 2.1 time: 0.153269 Jul 25 09:01:21.739648 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 636/1244] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:21 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:21.758867 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-cff685b0-88d5-467d-a081-8303e7e700ce tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:01:21.759481 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-cff685b0-88d5-467d-a081-8303e7e700ce tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:01:21.765907 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cff685b0-88d5-467d-a081-8303e7e700ce tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:21.766358 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cff685b0-88d5-467d-a081-8303e7e700ce tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:21.767120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cff685b0-88d5-467d-a081-8303e7e700ce tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:21.767557 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-cff685b0-88d5-467d-a081-8303e7e700ce tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:21.895574 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-cff685b0-88d5-467d-a081-8303e7e700ce tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:01:21.903055 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-cff685b0-88d5-467d-a081-8303e7e700ce tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1454 microversion: 2.1 time: 0.148014 Jul 25 09:01:21.903613 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 609/1245] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:01:21 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:01:23.480789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-c8282aab-d509-4137-8244-78d13f34354b req-56f5f16b-7ea1-4ea4-9b19-a407abfeeb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d52410-e972-457b-8d59-076ed8047b9f", "tag": "a5c293c4-0d71-4560-bd24-a3ca240a65f8"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:01:23.490513 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c8282aab-d509-4137-8244-78d13f34354b req-56f5f16b-7ea1-4ea4-9b19-a407abfeeb31 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:01:23.490955 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c8282aab-d509-4137-8244-78d13f34354b req-56f5f16b-7ea1-4ea4-9b19-a407abfeeb31 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:01:23.502746 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-c8282aab-d509-4137-8244-78d13f34354b req-56f5f16b-7ea1-4ea4-9b19-a407abfeeb31 service nova] Creating event network-changed:a5c293c4-0d71-4560-bd24-a3ca240a65f8 for instance 98d52410-e972-457b-8d59-076ed8047b9f on hv-cinder-85084 Jul 25 09:01:23.507753 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-c8282aab-d509-4137-8244-78d13f34354b req-56f5f16b-7ea1-4ea4-9b19-a407abfeeb31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030586 Jul 25 09:01:23.508421 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 637/1246] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:02:26.234385 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=26 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:26.235137 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=58 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:26.239065 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-69e091ff-fa80-4c58-8c40-e42a39c1ca6e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:02:26.239598 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-69e091ff-fa80-4c58-8c40-e42a39c1ca6e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:26.247145 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69e091ff-fa80-4c58-8c40-e42a39c1ca6e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:26.247596 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69e091ff-fa80-4c58-8c40-e42a39c1ca6e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:26.248352 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69e091ff-fa80-4c58-8c40-e42a39c1ca6e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:26.248821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-69e091ff-fa80-4c58-8c40-e42a39c1ca6e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:26.270856 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.objects.instance [None req-69e091ff-fa80-4c58-8c40-e42a39c1ca6e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lazy-loading 'flavor' on Instance uuid 43dee25d-a829-4ade-b3e3-05a11ae3d650 {{(pid=124234) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 09:02:26.340731 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-69e091ff-fa80-4c58-8c40-e42a39c1ca6e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "POST /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650/action" status: 202 len: 0 microversion: 2.1 time: 0.108137 Jul 25 09:02:26.341319 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 610/1247] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 09:02:26 2022] POST /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 09:02:26.348707 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:26.349449 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:26.354161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6437b50d-3dcc-4481-99ea-96e4f2ffa295 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:26.354964 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6437b50d-3dcc-4481-99ea-96e4f2ffa295 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:26.364688 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6437b50d-3dcc-4481-99ea-96e4f2ffa295 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:26.365253 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6437b50d-3dcc-4481-99ea-96e4f2ffa295 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:26.366002 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6437b50d-3dcc-4481-99ea-96e4f2ffa295 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:26.366926 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6437b50d-3dcc-4481-99ea-96e4f2ffa295 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:26.504015 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6437b50d-3dcc-4481-99ea-96e4f2ffa295 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:26.512395 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6437b50d-3dcc-4481-99ea-96e4f2ffa295 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.166639 Jul 25 09:02:26.512991 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 638/1248] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:26 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:27.535072 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-2d002230-45b4-4af8-b188-3df0e3039c3d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:27.535774 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-2d002230-45b4-4af8-b188-3df0e3039c3d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:27.542214 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2d002230-45b4-4af8-b188-3df0e3039c3d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:27.542662 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2d002230-45b4-4af8-b188-3df0e3039c3d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:27.543420 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2d002230-45b4-4af8-b188-3df0e3039c3d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:27.543859 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-2d002230-45b4-4af8-b188-3df0e3039c3d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:27.672435 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-2d002230-45b4-4af8-b188-3df0e3039c3d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:27.680467 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-2d002230-45b4-4af8-b188-3df0e3039c3d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.150243 Jul 25 09:02:27.681062 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 611/1249] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:27 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:28.756406 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5d238f1b-4d1f-451b-926d-c4904c3b1574 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:28.757697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5d238f1b-4d1f-451b-926d-c4904c3b1574 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:28.763842 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5d238f1b-4d1f-451b-926d-c4904c3b1574 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:28.764320 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5d238f1b-4d1f-451b-926d-c4904c3b1574 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:28.765104 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5d238f1b-4d1f-451b-926d-c4904c3b1574 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:28.765540 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5d238f1b-4d1f-451b-926d-c4904c3b1574 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:28.897914 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5d238f1b-4d1f-451b-926d-c4904c3b1574 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:28.905432 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5d238f1b-4d1f-451b-926d-c4904c3b1574 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.152894 Jul 25 09:02:28.905987 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 639/1250] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:28 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:29.927380 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-aa4c2dbf-d5b9-4079-b07e-727bb9008e01 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:29.928002 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-aa4c2dbf-d5b9-4079-b07e-727bb9008e01 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:29.935050 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aa4c2dbf-d5b9-4079-b07e-727bb9008e01 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:29.935500 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aa4c2dbf-d5b9-4079-b07e-727bb9008e01 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:29.936257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aa4c2dbf-d5b9-4079-b07e-727bb9008e01 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:29.936727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-aa4c2dbf-d5b9-4079-b07e-727bb9008e01 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:30.067902 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-aa4c2dbf-d5b9-4079-b07e-727bb9008e01 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:30.076017 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-aa4c2dbf-d5b9-4079-b07e-727bb9008e01 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.152529 Jul 25 09:02:30.076595 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 612/1251] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:29 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:31.097189 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-900a2dfa-7073-449e-b88a-8ee11e8e8c00 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:31.097795 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-900a2dfa-7073-449e-b88a-8ee11e8e8c00 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:31.105011 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-900a2dfa-7073-449e-b88a-8ee11e8e8c00 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:31.105465 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-900a2dfa-7073-449e-b88a-8ee11e8e8c00 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:31.106274 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-900a2dfa-7073-449e-b88a-8ee11e8e8c00 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:31.106713 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-900a2dfa-7073-449e-b88a-8ee11e8e8c00 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:31.245436 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-900a2dfa-7073-449e-b88a-8ee11e8e8c00 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:31.252906 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-900a2dfa-7073-449e-b88a-8ee11e8e8c00 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.159746 Jul 25 09:02:31.253470 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 640/1252] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:31 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:32.274991 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f11c1201-d391-40cd-9829-4b90854872c7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:32.275556 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f11c1201-d391-40cd-9829-4b90854872c7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:32.281923 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f11c1201-d391-40cd-9829-4b90854872c7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:32.282367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f11c1201-d391-40cd-9829-4b90854872c7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:32.283169 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f11c1201-d391-40cd-9829-4b90854872c7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:32.283602 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f11c1201-d391-40cd-9829-4b90854872c7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:32.416979 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-f11c1201-d391-40cd-9829-4b90854872c7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:32.424334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f11c1201-d391-40cd-9829-4b90854872c7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.153785 Jul 25 09:02:32.424929 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 613/1253] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:32 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:32.718661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:02:32.718904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Mon Jul 25 09:02:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:02:33.445437 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a4829f89-b38d-403b-8a22-ee13090fddac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:33.446042 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a4829f89-b38d-403b-8a22-ee13090fddac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:33.453006 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a4829f89-b38d-403b-8a22-ee13090fddac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:33.453455 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a4829f89-b38d-403b-8a22-ee13090fddac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:33.454205 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a4829f89-b38d-403b-8a22-ee13090fddac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:33.454637 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a4829f89-b38d-403b-8a22-ee13090fddac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:33.589173 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a4829f89-b38d-403b-8a22-ee13090fddac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:33.597848 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a4829f89-b38d-403b-8a22-ee13090fddac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.156195 Jul 25 09:02:33.598442 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 641/1254] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:33 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:34.618520 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e86c1275-dd1b-48ef-af75-ad397856adaf tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:34.619068 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e86c1275-dd1b-48ef-af75-ad397856adaf tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:34.625685 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e86c1275-dd1b-48ef-af75-ad397856adaf tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:34.626131 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e86c1275-dd1b-48ef-af75-ad397856adaf tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:34.626887 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e86c1275-dd1b-48ef-af75-ad397856adaf tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:34.627322 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e86c1275-dd1b-48ef-af75-ad397856adaf tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:34.766201 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e86c1275-dd1b-48ef-af75-ad397856adaf tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:34.773632 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e86c1275-dd1b-48ef-af75-ad397856adaf tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.159069 Jul 25 09:02:34.774190 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 614/1255] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:34 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:35.795312 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-88fa9b92-6346-4873-87f1-1b1a75a43c3c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:35.795930 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-88fa9b92-6346-4873-87f1-1b1a75a43c3c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:35.802572 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88fa9b92-6346-4873-87f1-1b1a75a43c3c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:35.803046 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88fa9b92-6346-4873-87f1-1b1a75a43c3c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:35.803839 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88fa9b92-6346-4873-87f1-1b1a75a43c3c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:35.804280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88fa9b92-6346-4873-87f1-1b1a75a43c3c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:35.946455 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-88fa9b92-6346-4873-87f1-1b1a75a43c3c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:35.954679 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-88fa9b92-6346-4873-87f1-1b1a75a43c3c tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.163314 Jul 25 09:02:35.955247 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 642/1256] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:35 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:36.975283 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5d442b90-70b0-4d74-9383-cf6f350348cd tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:36.975887 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5d442b90-70b0-4d74-9383-cf6f350348cd tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:36.983061 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5d442b90-70b0-4d74-9383-cf6f350348cd tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:36.983535 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5d442b90-70b0-4d74-9383-cf6f350348cd tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:36.984295 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5d442b90-70b0-4d74-9383-cf6f350348cd tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:36.984837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5d442b90-70b0-4d74-9383-cf6f350348cd tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:37.193127 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-5d442b90-70b0-4d74-9383-cf6f350348cd tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:37.202225 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5d442b90-70b0-4d74-9383-cf6f350348cd tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.230752 Jul 25 09:02:37.203692 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 615/1257] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:36 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:38.225192 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5395fc2b-b62d-42a6-b067-bb4d802f42cb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:38.225851 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5395fc2b-b62d-42a6-b067-bb4d802f42cb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:38.233179 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5395fc2b-b62d-42a6-b067-bb4d802f42cb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:38.233632 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5395fc2b-b62d-42a6-b067-bb4d802f42cb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:38.234401 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5395fc2b-b62d-42a6-b067-bb4d802f42cb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:38.234842 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5395fc2b-b62d-42a6-b067-bb4d802f42cb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:38.366406 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5395fc2b-b62d-42a6-b067-bb4d802f42cb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:38.374096 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5395fc2b-b62d-42a6-b067-bb4d802f42cb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.152784 Jul 25 09:02:38.374656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 643/1258] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:38 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:39.395106 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-d77f7af3-b564-49dd-b9be-9bd043a6e81f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:39.395832 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-d77f7af3-b564-49dd-b9be-9bd043a6e81f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:39.402934 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d77f7af3-b564-49dd-b9be-9bd043a6e81f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:39.403468 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d77f7af3-b564-49dd-b9be-9bd043a6e81f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:39.404306 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d77f7af3-b564-49dd-b9be-9bd043a6e81f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:39.404844 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-d77f7af3-b564-49dd-b9be-9bd043a6e81f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:39.541538 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-d77f7af3-b564-49dd-b9be-9bd043a6e81f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:39.549172 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-d77f7af3-b564-49dd-b9be-9bd043a6e81f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.158022 Jul 25 09:02:39.549739 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 616/1259] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:39 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:40.533016 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:02:40.533695 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Mon Jul 25 09:02:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:02:40.570624 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-95ae4554-c530-4bbe-b9f4-217021aff8e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:40.571170 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-95ae4554-c530-4bbe-b9f4-217021aff8e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:40.578429 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95ae4554-c530-4bbe-b9f4-217021aff8e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:40.578883 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95ae4554-c530-4bbe-b9f4-217021aff8e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:40.579777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95ae4554-c530-4bbe-b9f4-217021aff8e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:40.580243 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95ae4554-c530-4bbe-b9f4-217021aff8e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:40.712299 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-95ae4554-c530-4bbe-b9f4-217021aff8e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:40.719758 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-95ae4554-c530-4bbe-b9f4-217021aff8e5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1509 microversion: 2.1 time: 0.153044 Jul 25 09:02:40.720311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 644/1260] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:40 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:40.740551 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-0fc38590-3487-4fa7-ba24-db2a6f70b571 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:02:40.741140 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-0fc38590-3487-4fa7-ba24-db2a6f70b571 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:40.748781 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0fc38590-3487-4fa7-ba24-db2a6f70b571 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:40.749229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0fc38590-3487-4fa7-ba24-db2a6f70b571 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:40.749984 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0fc38590-3487-4fa7-ba24-db2a6f70b571 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:40.750410 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-0fc38590-3487-4fa7-ba24-db2a6f70b571 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:40.882706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-0fc38590-3487-4fa7-ba24-db2a6f70b571 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "POST /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650/action" status: 202 len: 0 microversion: 2.1 time: 0.145922 Jul 25 09:02:40.883410 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 617/1261] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Jul 25 09:02:40 2022] POST /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 09:02:40.891777 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e2df6f1e-511f-41f9-956c-ce985a5fe9d5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:40.892387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e2df6f1e-511f-41f9-956c-ce985a5fe9d5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:40.898292 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e2df6f1e-511f-41f9-956c-ce985a5fe9d5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:40.898745 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e2df6f1e-511f-41f9-956c-ce985a5fe9d5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:40.899508 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e2df6f1e-511f-41f9-956c-ce985a5fe9d5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:40.899954 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e2df6f1e-511f-41f9-956c-ce985a5fe9d5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:41.032264 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e2df6f1e-511f-41f9-956c-ce985a5fe9d5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:41.041286 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e2df6f1e-511f-41f9-956c-ce985a5fe9d5 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1517 microversion: 2.1 time: 0.152989 Jul 25 09:02:41.042157 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 645/1262] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:40 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:41.373947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-a46b9719-422a-4507-aec1-14a50e5c0a29 req-09866b95-b760-46cf-a926-1f7b778a9910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43dee25d-a829-4ade-b3e3-05a11ae3d650", "name": "network-vif-unplugged", "status": "completed", "tag": "b087c389-b3fd-48fa-8487-06d1bd3360c7"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:02:41.384334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-a46b9719-422a-4507-aec1-14a50e5c0a29 req-09866b95-b760-46cf-a926-1f7b778a9910 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:41.384820 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-a46b9719-422a-4507-aec1-14a50e5c0a29 req-09866b95-b760-46cf-a926-1f7b778a9910 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:41.404132 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.compute.server_external_events [req-a46b9719-422a-4507-aec1-14a50e5c0a29 req-09866b95-b760-46cf-a926-1f7b778a9910 service nova] Unable to find a host for instance 43dee25d-a829-4ade-b3e3-05a11ae3d650. Dropping event network-vif-unplugged {{(pid=124234) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 09:02:41.406076 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-a46b9719-422a-4507-aec1-14a50e5c0a29 req-09866b95-b760-46cf-a926-1f7b778a9910 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.099583 Jul 25 09:02:41.406076 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 618/1263] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 101 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 09:02:42.063578 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9f6fa3eb-cf57-4c73-b54a-fd0a598f2b19 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:42.064177 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9f6fa3eb-cf57-4c73-b54a-fd0a598f2b19 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:42.070650 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f6fa3eb-cf57-4c73-b54a-fd0a598f2b19 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:42.071096 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f6fa3eb-cf57-4c73-b54a-fd0a598f2b19 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:42.071928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f6fa3eb-cf57-4c73-b54a-fd0a598f2b19 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:42.073155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f6fa3eb-cf57-4c73-b54a-fd0a598f2b19 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:42.219013 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9f6fa3eb-cf57-4c73-b54a-fd0a598f2b19 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:42.227986 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9f6fa3eb-cf57-4c73-b54a-fd0a598f2b19 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1519 microversion: 2.1 time: 0.168305 Jul 25 09:02:42.229161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 646/1264] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:42 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:43.251136 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-ca56f4cb-512c-4fca-8303-871ac35d198a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:43.251739 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-ca56f4cb-512c-4fca-8303-871ac35d198a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:43.258108 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca56f4cb-512c-4fca-8303-871ac35d198a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:43.258558 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca56f4cb-512c-4fca-8303-871ac35d198a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:43.259322 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca56f4cb-512c-4fca-8303-871ac35d198a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:43.260269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-ca56f4cb-512c-4fca-8303-871ac35d198a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:43.405378 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-ca56f4cb-512c-4fca-8303-871ac35d198a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:43.412814 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-ca56f4cb-512c-4fca-8303-871ac35d198a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.165480 Jul 25 09:02:43.413389 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 619/1265] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:43 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:44.434362 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7777c8be-aeba-4d6d-afee-9f28fd71517a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:44.434968 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7777c8be-aeba-4d6d-afee-9f28fd71517a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:44.441548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7777c8be-aeba-4d6d-afee-9f28fd71517a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:44.442022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7777c8be-aeba-4d6d-afee-9f28fd71517a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:44.442771 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7777c8be-aeba-4d6d-afee-9f28fd71517a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:44.443203 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7777c8be-aeba-4d6d-afee-9f28fd71517a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:44.578250 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7777c8be-aeba-4d6d-afee-9f28fd71517a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:44.585704 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7777c8be-aeba-4d6d-afee-9f28fd71517a tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.155754 Jul 25 09:02:44.586261 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 647/1266] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:44 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:45.607872 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-55c480c1-b93e-4196-a6c8-138e5fddeff4 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:45.608381 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-55c480c1-b93e-4196-a6c8-138e5fddeff4 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:45.614954 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-55c480c1-b93e-4196-a6c8-138e5fddeff4 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:45.615402 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-55c480c1-b93e-4196-a6c8-138e5fddeff4 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:45.616151 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-55c480c1-b93e-4196-a6c8-138e5fddeff4 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:45.616604 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-55c480c1-b93e-4196-a6c8-138e5fddeff4 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:45.750481 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-55c480c1-b93e-4196-a6c8-138e5fddeff4 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:45.758658 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-55c480c1-b93e-4196-a6c8-138e5fddeff4 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.155200 Jul 25 09:02:45.759335 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 620/1267] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:45 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:46.781341 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8a4a3ddc-e4aa-49a4-ab28-838d8dc12e9f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:46.781950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8a4a3ddc-e4aa-49a4-ab28-838d8dc12e9f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:46.788434 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a4a3ddc-e4aa-49a4-ab28-838d8dc12e9f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:46.788907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a4a3ddc-e4aa-49a4-ab28-838d8dc12e9f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:46.789658 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a4a3ddc-e4aa-49a4-ab28-838d8dc12e9f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:46.790085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a4a3ddc-e4aa-49a4-ab28-838d8dc12e9f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:46.920163 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8a4a3ddc-e4aa-49a4-ab28-838d8dc12e9f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:46.927760 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8a4a3ddc-e4aa-49a4-ab28-838d8dc12e9f tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.150310 Jul 25 09:02:46.928316 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 648/1268] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:46 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:47.949425 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-af3448f5-2339-4406-a961-85727ff36592 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:47.950083 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-af3448f5-2339-4406-a961-85727ff36592 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:47.956830 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-af3448f5-2339-4406-a961-85727ff36592 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:47.957282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-af3448f5-2339-4406-a961-85727ff36592 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:47.958046 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-af3448f5-2339-4406-a961-85727ff36592 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:47.958500 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-af3448f5-2339-4406-a961-85727ff36592 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:48.087560 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-af3448f5-2339-4406-a961-85727ff36592 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:48.095594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-af3448f5-2339-4406-a961-85727ff36592 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.150117 Jul 25 09:02:48.096168 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 621/1269] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:47 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:49.117631 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4ae96eef-4e34-4900-b660-790a1e0f04d3 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:49.118286 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4ae96eef-4e34-4900-b660-790a1e0f04d3 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:49.125686 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4ae96eef-4e34-4900-b660-790a1e0f04d3 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:49.126131 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4ae96eef-4e34-4900-b660-790a1e0f04d3 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:49.126882 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4ae96eef-4e34-4900-b660-790a1e0f04d3 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:49.127319 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4ae96eef-4e34-4900-b660-790a1e0f04d3 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:49.267550 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4ae96eef-4e34-4900-b660-790a1e0f04d3 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:49.274995 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4ae96eef-4e34-4900-b660-790a1e0f04d3 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.161234 Jul 25 09:02:49.275557 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 649/1270] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:49 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:50.296805 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fd40a15f-dc35-4556-a503-adb0c6b03e45 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:50.297347 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fd40a15f-dc35-4556-a503-adb0c6b03e45 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:50.303905 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fd40a15f-dc35-4556-a503-adb0c6b03e45 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:50.304322 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fd40a15f-dc35-4556-a503-adb0c6b03e45 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:50.305112 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fd40a15f-dc35-4556-a503-adb0c6b03e45 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:50.305542 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fd40a15f-dc35-4556-a503-adb0c6b03e45 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:50.435320 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fd40a15f-dc35-4556-a503-adb0c6b03e45 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:50.442837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fd40a15f-dc35-4556-a503-adb0c6b03e45 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.150061 Jul 25 09:02:50.443404 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 622/1271] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:50 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:51.463563 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7dadad56-7057-4d18-be11-a9d0ef8658fe tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:51.464285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7dadad56-7057-4d18-be11-a9d0ef8658fe tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:51.471418 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7dadad56-7057-4d18-be11-a9d0ef8658fe tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:51.471937 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7dadad56-7057-4d18-be11-a9d0ef8658fe tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:51.472747 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7dadad56-7057-4d18-be11-a9d0ef8658fe tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:51.473184 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7dadad56-7057-4d18-be11-a9d0ef8658fe tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:51.611640 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7dadad56-7057-4d18-be11-a9d0ef8658fe tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:51.619225 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7dadad56-7057-4d18-be11-a9d0ef8658fe tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.159611 Jul 25 09:02:51.619793 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 650/1272] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:51 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:52.640796 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a596d9b1-a329-4032-942b-dc770dd677e7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:52.641441 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a596d9b1-a329-4032-942b-dc770dd677e7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:52.648313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a596d9b1-a329-4032-942b-dc770dd677e7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:52.648796 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a596d9b1-a329-4032-942b-dc770dd677e7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:52.649565 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a596d9b1-a329-4032-942b-dc770dd677e7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:52.649994 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a596d9b1-a329-4032-942b-dc770dd677e7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:52.862580 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a596d9b1-a329-4032-942b-dc770dd677e7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:52.870369 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a596d9b1-a329-4032-942b-dc770dd677e7 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.233358 Jul 25 09:02:52.870942 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 623/1273] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:52 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:53.379856 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-5fc49cf5-579d-49a4-b373-ae72445eb44a req-b659c419-135b-4afe-84a3-96136258bd6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43dee25d-a829-4ade-b3e3-05a11ae3d650", "name": "network-vif-plugged", "status": "completed", "tag": "b087c389-b3fd-48fa-8487-06d1bd3360c7"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:02:53.389738 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-5fc49cf5-579d-49a4-b373-ae72445eb44a req-b659c419-135b-4afe-84a3-96136258bd6e service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:53.390188 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-5fc49cf5-579d-49a4-b373-ae72445eb44a req-b659c419-135b-4afe-84a3-96136258bd6e service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:53.402247 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-5fc49cf5-579d-49a4-b373-ae72445eb44a req-b659c419-135b-4afe-84a3-96136258bd6e service nova] Creating event network-vif-plugged:b087c389-b3fd-48fa-8487-06d1bd3360c7 for instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 on hv-cinder-85084 Jul 25 09:02:53.407847 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-5fc49cf5-579d-49a4-b373-ae72445eb44a req-b659c419-135b-4afe-84a3-96136258bd6e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031703 Jul 25 09:02:53.408439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 651/1274] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:02:53.893092 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-240fdcb1-ce96-4375-b33c-8b9e0a93c154 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:53.893707 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-240fdcb1-ce96-4375-b33c-8b9e0a93c154 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:53.900258 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-240fdcb1-ce96-4375-b33c-8b9e0a93c154 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:53.900748 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-240fdcb1-ce96-4375-b33c-8b9e0a93c154 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:53.901515 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-240fdcb1-ce96-4375-b33c-8b9e0a93c154 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:53.901953 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-240fdcb1-ce96-4375-b33c-8b9e0a93c154 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:53.905987 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:54.031662 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-240fdcb1-ce96-4375-b33c-8b9e0a93c154 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:54.039212 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-240fdcb1-ce96-4375-b33c-8b9e0a93c154 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.150771 Jul 25 09:02:54.039782 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 624/1275] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:53 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 09:02:55.061452 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f52c3d60-0b75-4585-ad1e-73efd10c61bb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:55.062162 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f52c3d60-0b75-4585-ad1e-73efd10c61bb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:55.068468 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f52c3d60-0b75-4585-ad1e-73efd10c61bb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:55.068945 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f52c3d60-0b75-4585-ad1e-73efd10c61bb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:55.069706 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f52c3d60-0b75-4585-ad1e-73efd10c61bb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:55.070142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f52c3d60-0b75-4585-ad1e-73efd10c61bb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:55.198358 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f52c3d60-0b75-4585-ad1e-73efd10c61bb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:55.206790 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f52c3d60-0b75-4585-ad1e-73efd10c61bb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1575 microversion: 2.1 time: 0.149975 Jul 25 09:02:55.207442 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 652/1276] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:55 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:02:56.227287 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-215040cc-8b9a-4f65-9566-25b8f1543988 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:02:56.227906 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-215040cc-8b9a-4f65-9566-25b8f1543988 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:02:56.235366 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-215040cc-8b9a-4f65-9566-25b8f1543988 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:56.235813 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-215040cc-8b9a-4f65-9566-25b8f1543988 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:56.236586 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-215040cc-8b9a-4f65-9566-25b8f1543988 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:02:56.237028 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-215040cc-8b9a-4f65-9566-25b8f1543988 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:02:56.370729 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-215040cc-8b9a-4f65-9566-25b8f1543988 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:02:56.378256 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-215040cc-8b9a-4f65-9566-25b8f1543988 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1562 microversion: 2.1 time: 0.154870 Jul 25 09:02:56.378818 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 625/1277] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:02:56 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:24.807663 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1059947472", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1342922356", "security_groups": [{"name": "tempest-secgroup-smoke-2078811933"}], "block_device_mapping_v2": [{"uuid": "7355da9e-d264-49f8-a987-614384f97e89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1708f1a6-6a61-4ee3-995b-a3b155211357"}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:03:24.818365 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=30 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:24.819032 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=86 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:24.923097 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] validate_networks() for [('1708f1a6-6a61-4ee3-995b-a3b155211357', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 09:03:25.288065 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 09:03:25.289595 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 09:03:25.290114 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 09:03:25.290531 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 09:03:25.290950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 09:03:25.300588 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:25.301048 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:25.301844 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:25.302276 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:25.318812 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Getting quotas for project 5005a107ff1940908069356c788185f6. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 09:03:25.322776 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Getting quotas for user a1a3d224feb94a1baa75a03bc8d1132a and project 5005a107ff1940908069356c788185f6. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 09:03:25.380582 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 09:03:25.383323 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7355da9e-d264-49f8-a987-614384f97e89',volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 09:03:25.513591 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-85b40ed2-3d14-4892-9aa4-599da6220c97 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710212 Jul 25 09:03:25.514708 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 653/1278] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Jul 25 09:03:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 09:03:25.525709 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-93f82420-e900-4107-88a9-a7c98ab040fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:25.526334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-93f82420-e900-4107-88a9-a7c98ab040fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:25.531819 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=34 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:25.532493 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=10 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:25.586178 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-93f82420-e900-4107-88a9-a7c98ab040fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:25.593088 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-93f82420-e900-4107-88a9-a7c98ab040fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1095 microversion: 2.1 time: 0.071140 Jul 25 09:03:25.593594 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 626/1279] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:25 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:26.613759 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-38bc3773-f128-4339-963b-c47182c289dc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:26.614372 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-38bc3773-f128-4339-963b-c47182c289dc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:26.621667 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38bc3773-f128-4339-963b-c47182c289dc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:26.622118 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38bc3773-f128-4339-963b-c47182c289dc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:26.622939 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38bc3773-f128-4339-963b-c47182c289dc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:26.623379 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38bc3773-f128-4339-963b-c47182c289dc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:26.698020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-38bc3773-f128-4339-963b-c47182c289dc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:26.704969 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-38bc3773-f128-4339-963b-c47182c289dc tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1211 microversion: 2.1 time: 0.095655 Jul 25 09:03:26.705725 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 654/1280] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:26 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:27.726376 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-fd113011-a853-45de-b444-3ffe5d8c66fb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:27.727031 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-fd113011-a853-45de-b444-3ffe5d8c66fb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:27.733469 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fd113011-a853-45de-b444-3ffe5d8c66fb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:27.733922 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fd113011-a853-45de-b444-3ffe5d8c66fb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:27.734681 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fd113011-a853-45de-b444-3ffe5d8c66fb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:27.735113 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-fd113011-a853-45de-b444-3ffe5d8c66fb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:27.936385 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-fd113011-a853-45de-b444-3ffe5d8c66fb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:27.944380 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-fd113011-a853-45de-b444-3ffe5d8c66fb tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.221845 Jul 25 09:03:27.944980 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 627/1281] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:27 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 09:03:28.264277 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-af343805-8739-4e7d-be32-e240298914c9 req-5410b864-19a7-446e-aef8-1082939030a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6960f34f-7d42-47a7-acef-87777538f0ac", "tag": "a28e1196-fb89-4988-bd87-4ec3611bc58c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:03:28.275671 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-af343805-8739-4e7d-be32-e240298914c9 req-5410b864-19a7-446e-aef8-1082939030a1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:28.276108 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-af343805-8739-4e7d-be32-e240298914c9 req-5410b864-19a7-446e-aef8-1082939030a1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:28.290004 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-af343805-8739-4e7d-be32-e240298914c9 req-5410b864-19a7-446e-aef8-1082939030a1 service nova] Creating event network-changed:a28e1196-fb89-4988-bd87-4ec3611bc58c for instance 6960f34f-7d42-47a7-acef-87777538f0ac on hv-cinder-85084 Jul 25 09:03:28.296344 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-af343805-8739-4e7d-be32-e240298914c9 req-5410b864-19a7-446e-aef8-1082939030a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035306 Jul 25 09:03:28.297542 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 655/1282] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:03:28.965089 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-566372a7-439d-4ba5-ac22-18cff858732f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:28.965708 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-566372a7-439d-4ba5-ac22-18cff858732f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:28.972167 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-566372a7-439d-4ba5-ac22-18cff858732f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:28.972638 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-566372a7-439d-4ba5-ac22-18cff858732f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:28.973390 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-566372a7-439d-4ba5-ac22-18cff858732f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:28.973821 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-566372a7-439d-4ba5-ac22-18cff858732f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:29.108645 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-566372a7-439d-4ba5-ac22-18cff858732f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:29.116195 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-566372a7-439d-4ba5-ac22-18cff858732f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.154931 Jul 25 09:03:29.116797 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 628/1283] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:28 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:30.138007 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d8c0de64-a983-4c31-b841-4a7cd20651db tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:30.138712 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d8c0de64-a983-4c31-b841-4a7cd20651db tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:30.145746 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8c0de64-a983-4c31-b841-4a7cd20651db tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:30.146199 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8c0de64-a983-4c31-b841-4a7cd20651db tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:30.146963 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8c0de64-a983-4c31-b841-4a7cd20651db tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:30.147398 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8c0de64-a983-4c31-b841-4a7cd20651db tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:30.310532 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d8c0de64-a983-4c31-b841-4a7cd20651db tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:30.318065 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d8c0de64-a983-4c31-b841-4a7cd20651db tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.184210 Jul 25 09:03:30.318619 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 656/1284] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:30 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:31.338762 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-3d380da8-e891-47e2-88fe-608ca0530f0c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:31.339374 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-3d380da8-e891-47e2-88fe-608ca0530f0c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:31.346011 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3d380da8-e891-47e2-88fe-608ca0530f0c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:31.346461 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3d380da8-e891-47e2-88fe-608ca0530f0c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:31.347219 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3d380da8-e891-47e2-88fe-608ca0530f0c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:31.347653 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-3d380da8-e891-47e2-88fe-608ca0530f0c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:31.481253 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-3d380da8-e891-47e2-88fe-608ca0530f0c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:31.488531 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-3d380da8-e891-47e2-88fe-608ca0530f0c tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.153634 Jul 25 09:03:31.489110 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 629/1285] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:31 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:32.509811 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1bed3514-e513-405d-8ada-7a6e2752123f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:32.510400 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1bed3514-e513-405d-8ada-7a6e2752123f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:32.517539 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1bed3514-e513-405d-8ada-7a6e2752123f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:32.517985 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1bed3514-e513-405d-8ada-7a6e2752123f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:32.518740 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1bed3514-e513-405d-8ada-7a6e2752123f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:32.519170 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1bed3514-e513-405d-8ada-7a6e2752123f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:32.650933 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1bed3514-e513-405d-8ada-7a6e2752123f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:32.658950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1bed3514-e513-405d-8ada-7a6e2752123f tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.153004 Jul 25 09:03:32.659511 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 657/1286] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:32 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:33.679262 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1075f82a-ee78-48cb-990c-66e72ee28f28 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:33.679950 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1075f82a-ee78-48cb-990c-66e72ee28f28 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:33.686558 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1075f82a-ee78-48cb-990c-66e72ee28f28 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:33.687022 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1075f82a-ee78-48cb-990c-66e72ee28f28 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:33.687767 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1075f82a-ee78-48cb-990c-66e72ee28f28 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:33.688719 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1075f82a-ee78-48cb-990c-66e72ee28f28 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:33.817890 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1075f82a-ee78-48cb-990c-66e72ee28f28 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:33.825467 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1075f82a-ee78-48cb-990c-66e72ee28f28 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.150067 Jul 25 09:03:33.826029 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 630/1287] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:33 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:34.846309 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-763a9a1a-53a5-40ce-b00c-8982db3877a5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:34.846912 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-763a9a1a-53a5-40ce-b00c-8982db3877a5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:34.853872 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-763a9a1a-53a5-40ce-b00c-8982db3877a5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:34.854311 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-763a9a1a-53a5-40ce-b00c-8982db3877a5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:34.855061 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-763a9a1a-53a5-40ce-b00c-8982db3877a5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:34.855488 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-763a9a1a-53a5-40ce-b00c-8982db3877a5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:34.992101 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-763a9a1a-53a5-40ce-b00c-8982db3877a5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:34.999868 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-763a9a1a-53a5-40ce-b00c-8982db3877a5 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.157462 Jul 25 09:03:35.000441 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 658/1288] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:34 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:36.020825 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-a9e74793-13ec-4534-a439-eaf3dd9612fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:36.021435 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-a9e74793-13ec-4534-a439-eaf3dd9612fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:36.023502 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell0:SELECT=2 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:36.028803 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a9e74793-13ec-4534-a439-eaf3dd9612fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:36.029269 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a9e74793-13ec-4534-a439-eaf3dd9612fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:36.030000 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a9e74793-13ec-4534-a439-eaf3dd9612fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:36.030428 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-a9e74793-13ec-4534-a439-eaf3dd9612fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:36.160282 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-a9e74793-13ec-4534-a439-eaf3dd9612fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:36.167882 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-a9e74793-13ec-4534-a439-eaf3dd9612fa tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.151100 Jul 25 09:03:36.168446 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 631/1289] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:36 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:37.188565 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-24a141df-6a2a-4bef-9372-9d846caef15b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:37.189211 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-24a141df-6a2a-4bef-9372-9d846caef15b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:37.191185 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:37.191916 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:37.198628 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-24a141df-6a2a-4bef-9372-9d846caef15b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:37.199081 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-24a141df-6a2a-4bef-9372-9d846caef15b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:37.199846 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-24a141df-6a2a-4bef-9372-9d846caef15b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:37.200280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-24a141df-6a2a-4bef-9372-9d846caef15b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:37.335117 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-24a141df-6a2a-4bef-9372-9d846caef15b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:37.342560 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-24a141df-6a2a-4bef-9372-9d846caef15b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.157818 Jul 25 09:03:37.343137 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 659/1290] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:37 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:38.363199 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1e72d78e-a433-456a-9cff-0e3ca6f6b5d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:38.363815 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1e72d78e-a433-456a-9cff-0e3ca6f6b5d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:38.371120 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1e72d78e-a433-456a-9cff-0e3ca6f6b5d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:38.371575 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1e72d78e-a433-456a-9cff-0e3ca6f6b5d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:38.372333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1e72d78e-a433-456a-9cff-0e3ca6f6b5d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:38.372797 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1e72d78e-a433-456a-9cff-0e3ca6f6b5d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:38.504073 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1e72d78e-a433-456a-9cff-0e3ca6f6b5d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:38.512117 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1e72d78e-a433-456a-9cff-0e3ca6f6b5d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.152743 Jul 25 09:03:38.512706 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 632/1291] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:38 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:39.532695 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-63f87a75-c3bf-46d0-bf1a-909efdc3eb1b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:39.533412 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-63f87a75-c3bf-46d0-bf1a-909efdc3eb1b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:39.539950 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-63f87a75-c3bf-46d0-bf1a-909efdc3eb1b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:39.540397 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-63f87a75-c3bf-46d0-bf1a-909efdc3eb1b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:39.541189 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-63f87a75-c3bf-46d0-bf1a-909efdc3eb1b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:39.541619 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-63f87a75-c3bf-46d0-bf1a-909efdc3eb1b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:39.625242 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-324e174f-9f6b-4e19-ab56-16c558f95eee req-df4a6284-751d-4c09-930c-66fb587a94ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6960f34f-7d42-47a7-acef-87777538f0ac", "name": "network-vif-plugged", "status": "completed", "tag": "a28e1196-fb89-4988-bd87-4ec3611bc58c"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:03:39.636196 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-324e174f-9f6b-4e19-ab56-16c558f95eee req-df4a6284-751d-4c09-930c-66fb587a94ad service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:39.637099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-324e174f-9f6b-4e19-ab56-16c558f95eee req-df4a6284-751d-4c09-930c-66fb587a94ad service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:39.652257 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-324e174f-9f6b-4e19-ab56-16c558f95eee req-df4a6284-751d-4c09-930c-66fb587a94ad service nova] Creating event network-vif-plugged:a28e1196-fb89-4988-bd87-4ec3611bc58c for instance 6960f34f-7d42-47a7-acef-87777538f0ac on hv-cinder-85084 Jul 25 09:03:39.657495 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-324e174f-9f6b-4e19-ab56-16c558f95eee req-df4a6284-751d-4c09-930c-66fb587a94ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035939 Jul 25 09:03:39.658199 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 633/1292] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:03:39.684208 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-63f87a75-c3bf-46d0-bf1a-909efdc3eb1b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:39.692261 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-63f87a75-c3bf-46d0-bf1a-909efdc3eb1b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.163612 Jul 25 09:03:39.693239 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 660/1293] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:39 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 09:03:40.715220 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-676bb243-3bcc-4324-ab53-7a16e55e2399 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:40.715919 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-676bb243-3bcc-4324-ab53-7a16e55e2399 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:40.722087 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-676bb243-3bcc-4324-ab53-7a16e55e2399 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:40.722530 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-676bb243-3bcc-4324-ab53-7a16e55e2399 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:40.723277 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-676bb243-3bcc-4324-ab53-7a16e55e2399 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:40.723707 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-676bb243-3bcc-4324-ab53-7a16e55e2399 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:40.856809 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-676bb243-3bcc-4324-ab53-7a16e55e2399 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:40.864527 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-676bb243-3bcc-4324-ab53-7a16e55e2399 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1267 microversion: 2.1 time: 0.154504 Jul 25 09:03:40.865378 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 634/1294] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:40 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:41.885807 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9d1f4a81-bd2d-4115-94c4-e02f1cc411d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:41.886421 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9d1f4a81-bd2d-4115-94c4-e02f1cc411d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:41.892959 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d1f4a81-bd2d-4115-94c4-e02f1cc411d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:41.893408 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d1f4a81-bd2d-4115-94c4-e02f1cc411d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:41.894167 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d1f4a81-bd2d-4115-94c4-e02f1cc411d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:41.894602 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9d1f4a81-bd2d-4115-94c4-e02f1cc411d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:42.039187 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9d1f4a81-bd2d-4115-94c4-e02f1cc411d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:42.046893 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9d1f4a81-bd2d-4115-94c4-e02f1cc411d9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1455 microversion: 2.1 time: 0.164984 Jul 25 09:03:42.047458 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 661/1295] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:41 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:03:42.066561 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-51c4378c-54b5-46b0-bbf4-137ab75dc9e4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:03:42.067309 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-51c4378c-54b5-46b0-bbf4-137ab75dc9e4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:03:42.073671 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-51c4378c-54b5-46b0-bbf4-137ab75dc9e4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:42.074111 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-51c4378c-54b5-46b0-bbf4-137ab75dc9e4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:42.074861 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-51c4378c-54b5-46b0-bbf4-137ab75dc9e4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:42.075294 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-51c4378c-54b5-46b0-bbf4-137ab75dc9e4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:42.204793 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-51c4378c-54b5-46b0-bbf4-137ab75dc9e4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:03:42.213504 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-51c4378c-54b5-46b0-bbf4-137ab75dc9e4 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1455 microversion: 2.1 time: 0.150762 Jul 25 09:03:42.214066 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 635/1296] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:03:42 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 09:03:44.123908 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-e456df28-63a1-44a3-8a47-a42cd35371d9 req-d7da85b3-44b9-45e6-9e60-ea386af4d80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6960f34f-7d42-47a7-acef-87777538f0ac", "tag": "a28e1196-fb89-4988-bd87-4ec3611bc58c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:03:44.134411 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e456df28-63a1-44a3-8a47-a42cd35371d9 req-d7da85b3-44b9-45e6-9e60-ea386af4d80f service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:03:44.134857 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e456df28-63a1-44a3-8a47-a42cd35371d9 req-d7da85b3-44b9-45e6-9e60-ea386af4d80f service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:03:44.146439 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-e456df28-63a1-44a3-8a47-a42cd35371d9 req-d7da85b3-44b9-45e6-9e60-ea386af4d80f service nova] Creating event network-changed:a28e1196-fb89-4988-bd87-4ec3611bc58c for instance 6960f34f-7d42-47a7-acef-87777538f0ac on hv-cinder-85084 Jul 25 09:03:44.151564 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-e456df28-63a1-44a3-8a47-a42cd35371d9 req-d7da85b3-44b9-45e6-9e60-ea386af4d80f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031574 Jul 25 09:03:44.152175 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 662/1297] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:04:18.923177 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:04:18.923923 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Mon Jul 25 09:04:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:04:41.988182 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:04:41.988926 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c35dfd59-68b5-4888-82ba-bd4a1c1c896e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:04:41.989319 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c35dfd59-68b5-4888-82ba-bd4a1c1c896e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:04:41.989442 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=48 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:04:41.991990 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=22 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:04:41.992956 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=50 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:04:41.999073 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c35dfd59-68b5-4888-82ba-bd4a1c1c896e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:42.000045 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c35dfd59-68b5-4888-82ba-bd4a1c1c896e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:42.000947 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c35dfd59-68b5-4888-82ba-bd4a1c1c896e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:42.001442 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c35dfd59-68b5-4888-82ba-bd4a1c1c896e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:42.027661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c35dfd59-68b5-4888-82ba-bd4a1c1c896e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 09:04:42.119470 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c35dfd59-68b5-4888-82ba-bd4a1c1c896e tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "DELETE /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 204 len: 0 microversion: 2.1 time: 0.135109 Jul 25 09:04:42.120424 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 636/1298] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 09:04:41 2022] DELETE /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 09:04:42.130467 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-acd22a5e-1ffd-4f2e-95f1-193ffa72f3c6 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:04:42.131863 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-acd22a5e-1ffd-4f2e-95f1-193ffa72f3c6 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:04:42.138198 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-acd22a5e-1ffd-4f2e-95f1-193ffa72f3c6 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:42.138741 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-acd22a5e-1ffd-4f2e-95f1-193ffa72f3c6 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:42.139609 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-acd22a5e-1ffd-4f2e-95f1-193ffa72f3c6 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:42.140109 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-acd22a5e-1ffd-4f2e-95f1-193ffa72f3c6 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:42.165447 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-c2c573b0-9486-4ad5-9171-8635a142a5cd req-3334a058-54cc-491b-bd1f-69978ed2bcbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43dee25d-a829-4ade-b3e3-05a11ae3d650", "tag": "b087c389-b3fd-48fa-8487-06d1bd3360c7"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:04:42.175313 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c2c573b0-9486-4ad5-9171-8635a142a5cd req-3334a058-54cc-491b-bd1f-69978ed2bcbc service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:42.175736 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c2c573b0-9486-4ad5-9171-8635a142a5cd req-3334a058-54cc-491b-bd1f-69978ed2bcbc service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:42.188161 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-c2c573b0-9486-4ad5-9171-8635a142a5cd req-3334a058-54cc-491b-bd1f-69978ed2bcbc service nova] Creating event network-changed:b087c389-b3fd-48fa-8487-06d1bd3360c7 for instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 on hv-cinder-85084 Jul 25 09:04:42.194444 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-c2c573b0-9486-4ad5-9171-8635a142a5cd req-3334a058-54cc-491b-bd1f-69978ed2bcbc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207406 Jul 25 09:04:42.195034 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 663/1299] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 09:04:42.284661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-acd22a5e-1ffd-4f2e-95f1-193ffa72f3c6 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:04:42.293300 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-acd22a5e-1ffd-4f2e-95f1-193ffa72f3c6 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.167589 Jul 25 09:04:42.304239 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 637/1300] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:04:42 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 09:04:43.315735 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-44c5f48c-5ce7-46f8-91e3-c959154e1932 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:04:43.316426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-44c5f48c-5ce7-46f8-91e3-c959154e1932 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:04:43.323436 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-44c5f48c-5ce7-46f8-91e3-c959154e1932 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:43.323907 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-44c5f48c-5ce7-46f8-91e3-c959154e1932 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:43.324730 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-44c5f48c-5ce7-46f8-91e3-c959154e1932 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:43.325168 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-44c5f48c-5ce7-46f8-91e3-c959154e1932 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:43.542349 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-44c5f48c-5ce7-46f8-91e3-c959154e1932 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:04:43.550413 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-44c5f48c-5ce7-46f8-91e3-c959154e1932 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1568 microversion: 2.1 time: 0.238674 Jul 25 09:04:43.550997 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 664/1301] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:04:43 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:04:44.572748 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-1438df63-71b1-4799-aed3-a6374596e05d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:04:44.573439 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-1438df63-71b1-4799-aed3-a6374596e05d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:04:44.580106 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1438df63-71b1-4799-aed3-a6374596e05d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:44.580562 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1438df63-71b1-4799-aed3-a6374596e05d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:44.581360 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1438df63-71b1-4799-aed3-a6374596e05d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:44.581796 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-1438df63-71b1-4799-aed3-a6374596e05d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:44.658543 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-1438df63-71b1-4799-aed3-a6374596e05d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:04:44.659646 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-05d214c8-caa1-49a5-a939-8ece3f6cca7a req-93734dd3-9566-4e43-b14f-b1bcb2f3efc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43dee25d-a829-4ade-b3e3-05a11ae3d650", "name": "network-vif-deleted", "tag": "b087c389-b3fd-48fa-8487-06d1bd3360c7"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:04:44.667792 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-1438df63-71b1-4799-aed3-a6374596e05d tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1381 microversion: 2.1 time: 0.099820 Jul 25 09:04:44.668775 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 638/1302] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:04:44 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1381 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:04:44.681389 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-05d214c8-caa1-49a5-a939-8ece3f6cca7a req-93734dd3-9566-4e43-b14f-b1bcb2f3efc0 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:44.682118 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-05d214c8-caa1-49a5-a939-8ece3f6cca7a req-93734dd3-9566-4e43-b14f-b1bcb2f3efc0 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:44.694444 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-05d214c8-caa1-49a5-a939-8ece3f6cca7a req-93734dd3-9566-4e43-b14f-b1bcb2f3efc0 service nova] Creating event network-vif-deleted:b087c389-b3fd-48fa-8487-06d1bd3360c7 for instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 on hv-cinder-85084 Jul 25 09:04:44.700548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-05d214c8-caa1-49a5-a939-8ece3f6cca7a req-93734dd3-9566-4e43-b14f-b1bcb2f3efc0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048218 Jul 25 09:04:44.701397 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 665/1303] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:04:45.690313 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:04:45.690904 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:04:45.698186 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:45.698660 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:45.699545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:45.699810 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:45.733366 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:45.733720 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:45.734168 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.objects.instance [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lazy-loading 'fault' on Instance uuid 43dee25d-a829-4ade-b3e3-05a11ae3d650 {{(pid=124234) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 09:04:45.776694 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e9d0e3c2dd453eb4bfc2db6b45d80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a77723e8867459c99fcd86914fa44df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:04:45.785039 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-093f3333-9c06-4733-8f83-417ba93086eb tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 200 len: 1223 microversion: 2.1 time: 0.098675 Jul 25 09:04:45.785620 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 639/1304] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:04:45 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:04:46.807467 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0208169d-8e46-4b58-9d11-fee68d182dac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:04:46.808151 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0208169d-8e46-4b58-9d11-fee68d182dac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] [instance: 43dee25d-a829-4ade-b3e3-05a11ae3d650] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:04:46.814885 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0208169d-8e46-4b58-9d11-fee68d182dac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:46.815326 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0208169d-8e46-4b58-9d11-fee68d182dac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:46.816084 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0208169d-8e46-4b58-9d11-fee68d182dac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:04:46.816512 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0208169d-8e46-4b58-9d11-fee68d182dac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:04:46.830350 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-0208169d-8e46-4b58-9d11-fee68d182dac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] HTTP exception thrown: Instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 could not be found. Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0208169d-8e46-4b58-9d11-fee68d182dac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Request method failure captured: Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 HTTP/1.1 Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3ltcCpGZM10Cweh2p1cQvL_6xKc3PoP7YRsQuzIe6YmpEYl3FvYlvteLWYX2iLiSPlqAh2tdf5ZAY0Eo4TZiXN4M4gIKUDWrByfj5zxxgK5GfecH2i2Ub9mUH2g0yPlMIpg-CmDb5gs_EoSs-DvrkhsaT5xM3uTtKOfn0KPnay-NTfE Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 4a77723e8867459c99fcd86914fa44df Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-TestShelveInstance-778366475 Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 09:04:46.832020 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a77723e8867459c99fcd86914fa44df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4a77723e8867459c99fcd86914fa44df", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4a77723e8867459c99fcd86914fa44df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a77723e8867459c99fcd86914fa44df"}]}] Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-TestShelveInstance-778366475 Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 4a77723e8867459c99fcd86914fa44df Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-TestShelveInstance-778366475 Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-TestShelveInstance-778366475-project Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: 52e9d0e3c2dd453eb4bfc2db6b45d80f Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-TestShelveInstance-778366475-project Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 could not be found. Jul 25 09:04:46.834026 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '43dee25d-a829-4ade-b3e3-05a11ae3d650'} Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 could not be found. Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 09:04:46.835917 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 could not be found. Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 could not be found. Jul 25 09:04:46.837762 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:04:46.839302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0208169d-8e46-4b58-9d11-fee68d182dac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Returning 404 to user: Instance 43dee25d-a829-4ade-b3e3-05a11ae3d650 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 09:04:46.839302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0208169d-8e46-4b58-9d11-fee68d182dac tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650" status: 404 len: 111 microversion: 2.1 time: 0.030769 Jul 25 09:04:46.839302 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 666/1305] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:04:46 2022] GET /compute/v2.1/servers/43dee25d-a829-4ade-b3e3-05a11ae3d650 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 09:04:47.011224 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-4ddc18a9-7aa8-4317-8eda-5d65931b8343 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] Calling method '.version_select at 0x7f0f7976c280>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:04:47.035545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-4ddc18a9-7aa8-4317-8eda-5d65931b8343 tempest-TestShelveInstance-778366475 tempest-TestShelveInstance-778366475-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-328740924" status: 202 len: 0 microversion: 2.1 time: 0.028733 Jul 25 09:04:47.035998 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 640/1306] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Jul 25 09:04:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-328740924 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 09:05:44.930361 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-13bda271-36cf-4d2f-9b00-09178a2434a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:44.931148 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-13bda271-36cf-4d2f-9b00-09178a2434a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:44.933224 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=8 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:05:44.939492 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:05:44.940229 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG dbcounter [-] [124234] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:05:44.942155 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=12 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:05:44.949082 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13bda271-36cf-4d2f-9b00-09178a2434a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:44.949810 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13bda271-36cf-4d2f-9b00-09178a2434a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:44.950548 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13bda271-36cf-4d2f-9b00-09178a2434a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:44.951250 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13bda271-36cf-4d2f-9b00-09178a2434a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:44.980210 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-13bda271-36cf-4d2f-9b00-09178a2434a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 09:05:45.066642 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-13bda271-36cf-4d2f-9b00-09178a2434a9 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 204 len: 0 microversion: 2.1 time: 0.139754 Jul 25 09:05:45.068235 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 667/1307] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 09:05:44 2022] DELETE /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 09:05:45.078096 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6d83b079-8888-4346-a19d-1d463e0849c0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:45.078780 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6d83b079-8888-4346-a19d-1d463e0849c0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:45.084687 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d83b079-8888-4346-a19d-1d463e0849c0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:45.085123 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d83b079-8888-4346-a19d-1d463e0849c0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:45.086603 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d83b079-8888-4346-a19d-1d463e0849c0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:45.086603 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6d83b079-8888-4346-a19d-1d463e0849c0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:45.158727 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [req-76336e6e-5361-4d18-b3ab-d9018b8fc6c4 req-82a35d43-a605-4354-acf0-12ecb5bdd7fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6960f34f-7d42-47a7-acef-87777538f0ac", "tag": "a28e1196-fb89-4988-bd87-4ec3611bc58c"}]} {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:05:45.168650 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-76336e6e-5361-4d18-b3ab-d9018b8fc6c4 req-82a35d43-a605-4354-acf0-12ecb5bdd7fb service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:45.169099 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [req-76336e6e-5361-4d18-b3ab-d9018b8fc6c4 req-82a35d43-a605-4354-acf0-12ecb5bdd7fb service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:45.180732 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.compute.server_external_events [req-76336e6e-5361-4d18-b3ab-d9018b8fc6c4 req-82a35d43-a605-4354-acf0-12ecb5bdd7fb service nova] Creating event network-changed:a28e1196-fb89-4988-bd87-4ec3611bc58c for instance 6960f34f-7d42-47a7-acef-87777538f0ac on hv-cinder-85084 Jul 25 09:05:45.185968 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [req-76336e6e-5361-4d18-b3ab-d9018b8fc6c4 req-82a35d43-a605-4354-acf0-12ecb5bdd7fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251268 Jul 25 09:05:45.186620 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 641/1308] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:05:45.229705 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6d83b079-8888-4346-a19d-1d463e0849c0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:05:45.237415 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6d83b079-8888-4346-a19d-1d463e0849c0 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1580 microversion: 2.1 time: 0.164765 Jul 25 09:05:45.237980 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 668/1309] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:05:45 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1580 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:05:46.259895 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-c8167f4e-e838-4c36-b605-04b45e742d55 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:46.260624 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-c8167f4e-e838-4c36-b605-04b45e742d55 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:46.266882 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8167f4e-e838-4c36-b605-04b45e742d55 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:46.267310 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8167f4e-e838-4c36-b605-04b45e742d55 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:46.268074 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8167f4e-e838-4c36-b605-04b45e742d55 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:46.268513 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-c8167f4e-e838-4c36-b605-04b45e742d55 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:46.644939 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-c8167f4e-e838-4c36-b605-04b45e742d55 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:05:46.653021 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-c8167f4e-e838-4c36-b605-04b45e742d55 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1580 microversion: 2.1 time: 0.397364 Jul 25 09:05:46.653580 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 642/1310] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:05:46 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1580 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:05:47.257177 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-1e137299-3814-4774-a89b-c31cfe00910d req-ae5ae793-c5c9-4a6d-b9a4-73a3cf09b626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6960f34f-7d42-47a7-acef-87777538f0ac", "name": "network-vif-deleted", "tag": "a28e1196-fb89-4988-bd87-4ec3611bc58c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:05:47.268116 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1e137299-3814-4774-a89b-c31cfe00910d req-ae5ae793-c5c9-4a6d-b9a4-73a3cf09b626 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:47.268564 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1e137299-3814-4774-a89b-c31cfe00910d req-ae5ae793-c5c9-4a6d-b9a4-73a3cf09b626 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:47.282382 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-1e137299-3814-4774-a89b-c31cfe00910d req-ae5ae793-c5c9-4a6d-b9a4-73a3cf09b626 service nova] Creating event network-vif-deleted:a28e1196-fb89-4988-bd87-4ec3611bc58c for instance 6960f34f-7d42-47a7-acef-87777538f0ac on hv-cinder-85084 Jul 25 09:05:47.287614 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-1e137299-3814-4774-a89b-c31cfe00910d req-ae5ae793-c5c9-4a6d-b9a4-73a3cf09b626 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034115 Jul 25 09:05:47.288414 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 669/1311] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:05:47.674266 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-e9208e07-ee0b-4fac-9023-e5140364e705 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:47.674880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-e9208e07-ee0b-4fac-9023-e5140364e705 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:47.681742 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e9208e07-ee0b-4fac-9023-e5140364e705 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:47.682223 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e9208e07-ee0b-4fac-9023-e5140364e705 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:47.682975 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e9208e07-ee0b-4fac-9023-e5140364e705 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:47.684030 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-e9208e07-ee0b-4fac-9023-e5140364e705 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:47.751263 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-e9208e07-ee0b-4fac-9023-e5140364e705 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:05:47.759157 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-e9208e07-ee0b-4fac-9023-e5140364e705 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 200 len: 1226 microversion: 2.1 time: 0.088601 Jul 25 09:05:47.759704 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 643/1312] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:05:47 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:05:48.781426 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-609111b2-64cd-4a69-8990-511cdeccd47e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:48.782119 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-609111b2-64cd-4a69-8990-511cdeccd47e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 6960f34f-7d42-47a7-acef-87777538f0ac] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:48.788290 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-609111b2-64cd-4a69-8990-511cdeccd47e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:48.788767 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-609111b2-64cd-4a69-8990-511cdeccd47e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:48.789523 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-609111b2-64cd-4a69-8990-511cdeccd47e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:48.789952 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-609111b2-64cd-4a69-8990-511cdeccd47e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:48.802803 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-609111b2-64cd-4a69-8990-511cdeccd47e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] HTTP exception thrown: Instance 6960f34f-7d42-47a7-acef-87777538f0ac could not be found. Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-609111b2-64cd-4a69-8990-511cdeccd47e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Request method failure captured: Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac HTTP/1.1 Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lrf_Us6LQfgCPS2Lj5X24QVojjPdXJFkjziH5-YqSiHhsohlVOfXiQ-CA822z6sqEihVSpHzuOee-ua7B3lSpVG3apushh1ap5_jwHIYK8xGYdm7H_W1aXnPnygNyP_IAPFv9PLMzNt8pAN2BD022MNjixSYmWsMPUoTAIHmig2Gz4 Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 5005a107ff1940908069356c788185f6 Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 09:05:48.804385 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5005a107ff1940908069356c788185f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5005a107ff1940908069356c788185f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5005a107ff1940908069356c788185f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5005a107ff1940908069356c788185f6"}]}] Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 5005a107ff1940908069356c788185f6 Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-TestVolumeBootPattern-1324447603-project Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: a1a3d224feb94a1baa75a03bc8d1132a Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-TestVolumeBootPattern-1324447603-project Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 6960f34f-7d42-47a7-acef-87777538f0ac could not be found. Jul 25 09:05:48.806236 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '6960f34f-7d42-47a7-acef-87777538f0ac'} Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6960f34f-7d42-47a7-acef-87777538f0ac could not be found. Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 09:05:48.807244 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6960f34f-7d42-47a7-acef-87777538f0ac could not be found. Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6960f34f-7d42-47a7-acef-87777538f0ac could not be found. Jul 25 09:05:48.809608 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:48.811121 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-609111b2-64cd-4a69-8990-511cdeccd47e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Returning 404 to user: Instance 6960f34f-7d42-47a7-acef-87777538f0ac could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 09:05:48.811121 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-609111b2-64cd-4a69-8990-511cdeccd47e tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac" status: 404 len: 111 microversion: 2.1 time: 0.029079 Jul 25 09:05:48.811121 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 670/1313] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:05:48 2022] GET /compute/v2.1/servers/6960f34f-7d42-47a7-acef-87777538f0ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 09:05:52.113837 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-f8e94097-b266-49c6-b048-064b28070874 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:52.114367 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f8e94097-b266-49c6-b048-064b28070874 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:52.119441 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-48b40b07-8001-4187-a8d3-67010c10c434 req-92aa2440-b403-43cf-a456-5cb53bd43460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d52410-e972-457b-8d59-076ed8047b9f", "tag": "a5c293c4-0d71-4560-bd24-a3ca240a65f8"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:05:52.130298 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-48b40b07-8001-4187-a8d3-67010c10c434 req-92aa2440-b403-43cf-a456-5cb53bd43460 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:52.130750 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-48b40b07-8001-4187-a8d3-67010c10c434 req-92aa2440-b403-43cf-a456-5cb53bd43460 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:52.133724 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8e94097-b266-49c6-b048-064b28070874 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:52.134177 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8e94097-b266-49c6-b048-064b28070874 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:52.134976 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8e94097-b266-49c6-b048-064b28070874 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:52.135466 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-f8e94097-b266-49c6-b048-064b28070874 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:52.142293 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-48b40b07-8001-4187-a8d3-67010c10c434 req-92aa2440-b403-43cf-a456-5cb53bd43460 service nova] Creating event network-changed:a5c293c4-0d71-4560-bd24-a3ca240a65f8 for instance 98d52410-e972-457b-8d59-076ed8047b9f on hv-cinder-85084 Jul 25 09:05:52.147536 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-48b40b07-8001-4187-a8d3-67010c10c434 req-92aa2440-b403-43cf-a456-5cb53bd43460 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031842 Jul 25 09:05:52.148554 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 671/1314] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:05:52.161551 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-f8e94097-b266-49c6-b048-064b28070874 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Going to try to terminate instance {{(pid=124234) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 09:05:52.253479 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-f8e94097-b266-49c6-b048-064b28070874 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "DELETE /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 204 len: 0 microversion: 2.1 time: 0.143628 Jul 25 09:05:52.254302 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 644/1315] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 09:05:52 2022] DELETE /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 09:05:52.263285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ee9b026e-178d-4910-8e58-0a98b329a776 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:52.264002 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ee9b026e-178d-4910-8e58-0a98b329a776 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:52.270535 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ee9b026e-178d-4910-8e58-0a98b329a776 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:52.270991 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ee9b026e-178d-4910-8e58-0a98b329a776 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:52.271765 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ee9b026e-178d-4910-8e58-0a98b329a776 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:52.272203 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ee9b026e-178d-4910-8e58-0a98b329a776 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:52.438739 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ee9b026e-178d-4910-8e58-0a98b329a776 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:05:52.446453 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ee9b026e-178d-4910-8e58-0a98b329a776 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1578 microversion: 2.1 time: 0.187399 Jul 25 09:05:52.447022 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 672/1316] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:05:52 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:05:53.468069 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-48da2eda-9f5b-4f59-80d1-27172ab530a2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:53.468785 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-48da2eda-9f5b-4f59-80d1-27172ab530a2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:53.475135 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-48da2eda-9f5b-4f59-80d1-27172ab530a2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:53.475583 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-48da2eda-9f5b-4f59-80d1-27172ab530a2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:53.476334 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-48da2eda-9f5b-4f59-80d1-27172ab530a2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:53.476787 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-48da2eda-9f5b-4f59-80d1-27172ab530a2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:53.637048 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-48da2eda-9f5b-4f59-80d1-27172ab530a2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:05:53.644534 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-48da2eda-9f5b-4f59-80d1-27172ab530a2 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1578 microversion: 2.1 time: 0.180695 Jul 25 09:05:53.645196 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 645/1317] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:05:53 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:05:54.404437 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-e6b20587-c1aa-400e-8f05-26ddcf769791 req-0d1b737a-6ee0-4272-876b-82d4b691ccc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d52410-e972-457b-8d59-076ed8047b9f", "name": "network-vif-deleted", "tag": "a5c293c4-0d71-4560-bd24-a3ca240a65f8"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 09:05:54.415094 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e6b20587-c1aa-400e-8f05-26ddcf769791 req-0d1b737a-6ee0-4272-876b-82d4b691ccc1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:54.415533 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e6b20587-c1aa-400e-8f05-26ddcf769791 req-0d1b737a-6ee0-4272-876b-82d4b691ccc1 service nova] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:54.426323 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-e6b20587-c1aa-400e-8f05-26ddcf769791 req-0d1b737a-6ee0-4272-876b-82d4b691ccc1 service nova] Creating event network-vif-deleted:a5c293c4-0d71-4560-bd24-a3ca240a65f8 for instance 98d52410-e972-457b-8d59-076ed8047b9f on hv-cinder-85084 Jul 25 09:05:54.432057 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-e6b20587-c1aa-400e-8f05-26ddcf769791 req-0d1b737a-6ee0-4272-876b-82d4b691ccc1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 Jul 25 09:05:54.432970 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 673/1318] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Jul 25 09:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 09:05:54.666171 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b0e70986-4cdd-4edb-badb-9e182a39f922 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:54.666810 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-b0e70986-4cdd-4edb-badb-9e182a39f922 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:54.674213 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b0e70986-4cdd-4edb-badb-9e182a39f922 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:54.674667 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b0e70986-4cdd-4edb-badb-9e182a39f922 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:54.675446 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b0e70986-4cdd-4edb-badb-9e182a39f922 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:54.676040 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-b0e70986-4cdd-4edb-badb-9e182a39f922 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:54.742644 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.policy [None req-b0e70986-4cdd-4edb-badb-9e182a39f922 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d224feb94a1baa75a03bc8d1132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5005a107ff1940908069356c788185f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124234) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 09:05:54.752177 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b0e70986-4cdd-4edb-badb-9e182a39f922 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 200 len: 1226 microversion: 2.1 time: 0.090038 Jul 25 09:05:54.752817 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 646/1319] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:05:54 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 09:05:54.766697 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:05:54.766966 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Mon Jul 25 09:05:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:05:55.773447 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7434e6cc-b664-4649-ae0c-fedbe20ed5ee tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:55.774434 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7434e6cc-b664-4649-ae0c-fedbe20ed5ee tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 98d52410-e972-457b-8d59-076ed8047b9f] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:55.780282 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7434e6cc-b664-4649-ae0c-fedbe20ed5ee tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:55.781387 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7434e6cc-b664-4649-ae0c-fedbe20ed5ee tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:55.782229 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7434e6cc-b664-4649-ae0c-fedbe20ed5ee tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:55.782656 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7434e6cc-b664-4649-ae0c-fedbe20ed5ee tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:55.795571 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-7434e6cc-b664-4649-ae0c-fedbe20ed5ee tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] HTTP exception thrown: Instance 98d52410-e972-457b-8d59-076ed8047b9f could not be found. Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7434e6cc-b664-4649-ae0c-fedbe20ed5ee tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Request method failure captured: Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f HTTP/1.1 Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lrf_Us6LQfgCPS2Lj5X24QVojjPdXJFkjziH5-YqSiHhsohlVOfXiQ-CA822z6sqEihVSpHzuOee-ua7B3lSpVG3apushh1ap5_jwHIYK8xGYdm7H_W1aXnPnygNyP_IAPFv9PLMzNt8pAN2BD022MNjixSYmWsMPUoTAIHmig2Gz4 Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 5005a107ff1940908069356c788185f6 Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 09:05:55.797218 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5005a107ff1940908069356c788185f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5005a107ff1940908069356c788185f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5005a107ff1940908069356c788185f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5005a107ff1940908069356c788185f6"}]}] Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 5005a107ff1940908069356c788185f6 Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-TestVolumeBootPattern-1324447603-project Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: a1a3d224feb94a1baa75a03bc8d1132a Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-TestVolumeBootPattern-1324447603-project Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 98d52410-e972-457b-8d59-076ed8047b9f could not be found. Jul 25 09:05:55.798928 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '98d52410-e972-457b-8d59-076ed8047b9f'} Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d52410-e972-457b-8d59-076ed8047b9f could not be found. Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 09:05:55.800085 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d52410-e972-457b-8d59-076ed8047b9f could not be found. Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d52410-e972-457b-8d59-076ed8047b9f could not be found. Jul 25 09:05:55.801742 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:55.803393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7434e6cc-b664-4649-ae0c-fedbe20ed5ee tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Returning 404 to user: Instance 98d52410-e972-457b-8d59-076ed8047b9f could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 09:05:55.803393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7434e6cc-b664-4649-ae0c-fedbe20ed5ee tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f" status: 404 len: 111 microversion: 2.1 time: 0.030064 Jul 25 09:05:55.803393 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 674/1320] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:05:55 2022] GET /compute/v2.1/servers/98d52410-e972-457b-8d59-076ed8047b9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 09:05:56.224661 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5249e167-6da4-40c1-a280-a93e1053b687 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:56.227327 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.compute.api [None req-5249e167-6da4-40c1-a280-a93e1053b687 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124234) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:56.234874 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5249e167-6da4-40c1-a280-a93e1053b687 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:56.235333 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5249e167-6da4-40c1-a280-a93e1053b687 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:56.236110 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5249e167-6da4-40c1-a280-a93e1053b687 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:56.236553 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG oslo_concurrency.lockutils [None req-5249e167-6da4-40c1-a280-a93e1053b687 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:56.251394 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.wsgi [None req-5249e167-6da4-40c1-a280-a93e1053b687 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] HTTP exception thrown: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5249e167-6da4-40c1-a280-a93e1053b687 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Request method failure captured: Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: request: DELETE /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 HTTP/1.1 Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept: application/json Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Accept-Encoding: identity Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Connection: close Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Length: 0 Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Content-Type: application/json Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Host: 10.222.0.52 Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Openstack-System-Scope: None Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: User-Agent: python-urllib3/1.26.10 Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Auth-Token: gAAAAABi3lrf_Us6LQfgCPS2Lj5X24QVojjPdXJFkjziH5-YqSiHhsohlVOfXiQ-CA822z6sqEihVSpHzuOee-ua7B3lSpVG3apushh1ap5_jwHIYK8xGYdm7H_W1aXnPnygNyP_IAPFv9PLMzNt8pAN2BD022MNjixSYmWsMPUoTAIHmig2Gz4 Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Id: None Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Domain-Name: None Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Identity-Status: Confirmed Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Is-Admin-Project: True Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Id: default Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Domain-Name: Default Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Id: 5005a107ff1940908069356c788185f6 Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Project-Name: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Role: reader,member Jul 25 09:05:56.253098 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Roles: reader,member Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5005a107ff1940908069356c788185f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5005a107ff1940908069356c788185f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5005a107ff1940908069356c788185f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5005a107ff1940908069356c788185f6"}]}] Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Id: 5005a107ff1940908069356c788185f6 Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-Tenant-Name: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User: tempest-TestVolumeBootPattern-1324447603-project Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Id: default Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Domain-Name: Default Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Id: a1a3d224feb94a1baa75a03bc8d1132a Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: X-User-Name: tempest-TestVolumeBootPattern-1324447603-project Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: method: > Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: exception: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:05:56.254880 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: action_args: {'id': '885b3722-2c57-4d32-9bf3-9d376ea3c909'} Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 09:05:56.255958 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:05:56.257696 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: ERROR nova.api.openstack.wsgi Jul 25 09:05:56.259536 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-5249e167-6da4-40c1-a280-a93e1053b687 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Returning 404 to user: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. {{(pid=124234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 09:05:56.259536 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-5249e167-6da4-40c1-a280-a93e1053b687 tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "DELETE /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 404 len: 111 microversion: 2.1 time: 0.033844 Jul 25 09:05:56.259536 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 647/1321] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Jul 25 09:05:56 2022] DELETE /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 09:05:56.263087 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-362ce6f0-a044-4c29-986b-cdbd24b39c9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:56.263706 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-362ce6f0-a044-4c29-986b-cdbd24b39c9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] [instance: 885b3722-2c57-4d32-9bf3-9d376ea3c909] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 09:05:56.270763 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-362ce6f0-a044-4c29-986b-cdbd24b39c9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:56.271219 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-362ce6f0-a044-4c29-986b-cdbd24b39c9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:56.271986 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-362ce6f0-a044-4c29-986b-cdbd24b39c9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 09:05:56.272456 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-362ce6f0-a044-4c29-986b-cdbd24b39c9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Lock "7421014a-aeb3-45a4-96f3-f2b361a942ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 09:05:56.285789 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-362ce6f0-a044-4c29-986b-cdbd24b39c9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] HTTP exception thrown: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-362ce6f0-a044-4c29-986b-cdbd24b39c9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Request method failure captured: Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 HTTP/1.1 Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Connection: close Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Host: 10.222.0.52 Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi3lrf_Us6LQfgCPS2Lj5X24QVojjPdXJFkjziH5-YqSiHhsohlVOfXiQ-CA822z6sqEihVSpHzuOee-ua7B3lSpVG3apushh1ap5_jwHIYK8xGYdm7H_W1aXnPnygNyP_IAPFv9PLMzNt8pAN2BD022MNjixSYmWsMPUoTAIHmig2Gz4 Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Id: 5005a107ff1940908069356c788185f6 Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 25 09:05:56.287285 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5005a107ff1940908069356c788185f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5005a107ff1940908069356c788185f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5005a107ff1940908069356c788185f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5005a107ff1940908069356c788185f6"}]}] Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 5005a107ff1940908069356c788185f6 Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-TestVolumeBootPattern-1324447603 Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User: tempest-TestVolumeBootPattern-1324447603-project Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Id: a1a3d224feb94a1baa75a03bc8d1132a Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-TestVolumeBootPattern-1324447603-project Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: method: > Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: exception: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:05:56.289135 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: action_args: {'id': '885b3722-2c57-4d32-9bf3-9d376ea3c909'} Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 09:05:56.290067 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. Jul 25 09:05:56.291721 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 25 09:05:56.293252 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-362ce6f0-a044-4c29-986b-cdbd24b39c9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Returning 404 to user: Instance 885b3722-2c57-4d32-9bf3-9d376ea3c909 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 09:05:56.293252 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-362ce6f0-a044-4c29-986b-cdbd24b39c9a tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909" status: 404 len: 111 microversion: 2.1 time: 0.029372 Jul 25 09:05:56.293252 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 675/1322] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Jul 25 09:05:56 2022] GET /compute/v2.1/servers/885b3722-2c57-4d32-9bf3-9d376ea3c909 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 09:05:57.582406 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: DEBUG nova.api.openstack.wsgi [None req-b8e90e5d-8838-478f-b223-50a8adcad41b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] Calling method '.version_select at 0x7f0f7977a9d0>' {{(pid=124234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 09:05:57.602867 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO nova.api.openstack.requestlog [None req-b8e90e5d-8838-478f-b223-50a8adcad41b tempest-TestVolumeBootPattern-1324447603 tempest-TestVolumeBootPattern-1324447603-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1342922356" status: 202 len: 0 microversion: 2.1 time: 0.024885 Jul 25 09:05:57.603545 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: [pid: 124234|app: 0|req: 648/1323] 10.222.0.52 () {58 vars in 1263 bytes} [Mon Jul 25 09:05:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1342922356 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 09:06:00.542447 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:06:00.543013 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Mon Jul 25 09:06:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:07:38.932224 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:07:38.933280 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Mon Jul 25 09:07:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:09:12.730433 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:09:12.731084 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Mon Jul 25 09:09:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:09:14.775142 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:09:14.775751 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Mon Jul 25 09:09:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:09:20.551236 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:09:20.551822 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Mon Jul 25 09:09:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:10:58.940647 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:10:58.941331 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Mon Jul 25 09:10:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:11:17.448273 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:11:17.448933 dv-cinder-850840-1-iscsi devstack@n-api.service[124234]: Mon Jul 25 09:11:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 09:11:18.694240 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 09:11:18.694849 dv-cinder-850840-1-iscsi devstack@n-api.service[124235]: Mon Jul 25 09:11:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!